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Abstract. A central limit theorem (CLT) for the smoothed empirical spectral dis- 
tribution of sample covariance matrices is established. Moreover, the CLTs for the 
smoothed quantiles of Marcenko and Pastur's law have been also developed. 



1. Introduction 



The sample covariance matrix is defined by 

An = ix„X^, where X„ = (Xij)pxn 

with {Xij}, i,j = ---, being a double array of independent and identically distributed 
(i.i.d.) real random variables (r.v.'s) with EXu = and ^Xf^ = 1. In the large 
dimensional random matrix theory, the sample covariance matrix is a prominent model. 
One reason is that its eigenvalues are not only interesting in its own right, but also 
play important roles in many other areas of mathematics and engineering, such as 
combinatorics [16] . mathematical physics |18j, probability [Ij, statistics jtl4j and wireless 
communications [19] . Its study dates back to the work of Wishart [25] , who considered 
the case where all X^j are Gaussian r.v.'s. In this particular model, the joint distribution 
of the eigenvalues of A„ can be explicitly computed (as a special case of the Laguerre 
orthogonal ensemble). One can use this explicit formula to directly obtain the law of 
local eigenvalues in large dimensions, such as the distribution of the largest one |121ll4j. 
the smallest one [7], and the bulk ones [23]. Also it is widely conjectured that these 
limiting behaviors hold for a much larger class of sample covariance matrices. For recent 
progress in this direction, we refer to |9]. By comparison, the universality of the Wigner 
matrices and /3-ensembles is well developed, see [23] and [8]. 

However, in order to capture the whole picture of the eigenvalues of sample covariance 
matrices, it is necessary to study the behavior of all eigenvalues. A good candidate for 
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this purpose is the empirical spectral distribution (ESD) defined by 

FAn(^) = lV/(Afc<x), 



' k=l 

where Xk,k = 1, - ■ ■ ,p are the eigenvalues of A„. It is equivalent to consider 

1 rp 

n 

because the eigenvalues of A„ and B„ differ by |n— p| zero eigenvalues. The almost sure 
convergence of F-^" to the famous Marcenko-Pastur law (MP law) is fully understood 
under the 2nd moment condition of Xn when the dimension p is of the same order as 
the sample size n. There has been a vast literature on this topic. One can refer to the 
pioneer work [TT] and the recent book [3]. 

After establishing the strong law of large numbers (SLLN), one may wish to prove 
the central limit theorem (CLT). However, as far as we know, even for the Wishart 
ensemble, there is no CLT available in the literature about F-^"{-) due to the shortage 
of powerful tools. Hence it is also impossible to make inference based on the individual 
eigenvalue of the sample covariance matrix when one only has finite moment conditions. 
These difficulties push one to seek other possible ways to make statistical inference. 

Motivated by the "smoothing" ideas, Jing, Pan, Shao and Zhou [llj propose the 
following kernel estimators of the distribution function of the MP law, 

(1-1) Fn{x) = [ fn{y)dy, 

J —oo 

where 

(1.2) /„(.) = ±p<C-^) = ljKC-^),F^Hy). 

K(-) is a smooth function and h is the bandwidth tending to zero as n — t- oo. Intuitively, 
Fn{-) depicts the global picture of all eigenvalues and should have no much difference 
from F-^"{-). It was proved in that -Fn(-) almost surely converges to the MP law 
under some regularity conditions. 

The main aim of this paper is to establish the CLTs for Fn{x), the smoothed version 
of the empirical spectral distribution F-^" , and fn{x)- Moreover we develop CLTs for 
the a-th quantile of Fn{-), which is a smoothed version of the [pa]-th largest eigenvalue 
of A„. 



2. MAIN RESULTS 

We first introduce some necessary notation, assumptions and some basic facts about 
the MP law. 

In this paper, we suppose that the ratio of the dimension and sample size Cn = p/n 
tends to a positive constant c as n — >• oo. Then F^"{-) tends to the so-called Marcenko 
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and Pastur law with the density function 

J {27rcx)^^ \/ {h — x){x — a) a < x <b. 
otherwise. 



1< 



It has point mass 1 — at the origin if c > 1, where a = (1 — ^/c)'^ and b = {1 + ^fcf' 
(see [1]). The distribution function of the MP law is denoted by Fc(-). The Stieltjes 
transform of the MP law is 



(2.1) m{z) = 1 ^ 

which satisfies the equation 

(2.2) m{z) = . 

1 — c — czm[z) — z 

Here the Stieltjes transform mF{ ) for any probability distribution function F{-) is given 
by 

(2.3) mF{z)= [ ^—dF(x), z e C+ . 

J X - z 

The relationship between the Stieltjes transform of the limit of (•) and m(-) is given 
by 

1 - c 

(2.4) m{z) = h cm(z). 

which gives the equation satisfied by m(-) 

1 r 

(2.5) z = + 



m{z) 1 + m(z) 

For the kernel function K{-) we assume that 

(2.6) lim \xK{x)\= lim \xK'{x)\=0, 

\x\—^oo |a;|— >oo 

(2.7) j K{x)dx = 1' y \xK'{x)\dx j \K"{x)\dx < oo. 
and 

(2.8) j xK{x)dx = 0, y x'^\K{x)\dx < oo. 

Let z = u + iv, where n G M and t> is in a bounded interval, say [—vq, vq] with vq > 0. 
Suppose that 

r+oo 

(2.9) / \ K'^^\z)\du < oo, j = 0,1,2, 



uniformly in v G [—vq,vq], where K^^\z) denotes the j-th derivative of K{z). Also 
suppose that 

(2.10) lim \xK{x + ivo)\= lim \xK'{x + ivo)\ = 0. 

^oo |a;|— >co 
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Our first result is the CLT for — ¥c„{x)). 

Theorem 1. Suppose that 

1) h = h{n) is a sequence of positive constants satisfying 

nh^ , 1 

lim —;^=^= — 0, lim —pr — 0, 

2) K{x) satisfies i2. 6\) - [27W\) and is analytic on open interval including 

a — b 6 — a, 

3) Xij are i.i.d. with EXu = 0, Var{Xii) = 1, EXf^ = 3 and EXff < oo, 
c„ ^ c e (0, 1) ; 



Then, as n ^ oo, for any fixed positive integer d and different points xi,--- ,Xd in 
{a,b), the joint limiting distribution of 

'Inn 

is multivariate normal with mean zero and covariance matrix I, the dxd identity matrix. 



(2.11) ^(i^„(x,)-F,„(x,)), j = l,. 



Remark 1. The convergence rate n/\/lnn is consistent with the conjectured convergence 
rate n/^/hvn of the ESD of sample covariance matrices to the MP law. 

Remark 2. It is easy to check that the Gaussian kernel {2-K)~'^/'^e~^'^ ^"^ satisfies all 
conditions specified in TheoremUl 

Based on Theorem [T] we may further develop the smoothed quantile estimators of the 
MP law. For < a < 1, define the a-quantile of the MP law by 

(2.12) Xa = mf{x,¥c„{x)>a} 
and its estimator by 

(2.13) Xn,a = inf{x,F„(x) > a}. 

Theorem 2. Under the assumptions of TheoremUl 
n 1 

Xn^a Xa 



The next theorem is the CLT for fn{x). 
Theorem 3. Suppose that 

1) h = h{n) is a sequence of positive constants satisfying 

In h^"^ 

(2.14) lim — -5 > 0, lim n/i^ = ; 

2) K{x) satisfies \2. 0\I - [2A^) and is analytic on open interval including 

a — b b — a 
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3) Xij are i.i.d. with EXn = 0, Var{Xii) = I, EXf^ = 3 and EXf^^ < oo, 
Cn^ce (0, 1) ; 

Then, as n ^ oo, for any fixed positive integer d and different points xi,--- ,Xd in 
{a,b), the joint limiting distribution of 

(2.15) nh[jn{xj) - fcSxj)^, j = l,---,d 

is multivariate normal with mean zero and covariance matrix o"^ /, where 

£7^ = --— 2 / / K'{ui)K'{u2)\n{ui - U2)'^duidU2. 

J —oo J —oo 

Note that the Gaussian kernel (27r)^^/^e~^^/^ also satisfies all conditions specified in 
Theorem [3l Theorem [3] is actually a corollary of the following theorem. 

Theorem 4. When the condition lim„^oo = in Theorem\^is replaced by 

lim h = 

while the remaining conditions are unchanged, Theorem holds as well if the random 
variables i2.15\) are replaced by 



nhfnixj)-^j ^( ^\ ^ )dFcn{y) , Xj £ {a, b), j = !,■■■ ,d 

The paper is organized as follows. Theorem U] is proved in Section [3l and some calcu- 
lations involved in the proof are deferred to Appendix 2. In Section U we establish the 
optimal orders for E(r(z))^ and E(r(z))^ where r(^;) = n~"^trA~"^(2;) — n~^EtrA~^(z) 
with A~^{z) = (A„ — zl)~^, z = u + iv and v > Mj^/n for some constant M. It is 
the most difficult and important result of this paper. In Section [5l we derive the limit 
of {^■ni)'^^ <f K{{x — z) / h)n{Kmn{z) — m^{z))dz, which is essential to Theorem[TJ The 
proof of Theorems [3] and [1] is completed in Section [6l Section [7] handles Theorem [2j 
Some technical lemmas are given in Appendix 1. 

Before concluding this section, let us say a few words about the proof of Theorem 
[H Key breakthroughs are to establish optimal orders for E(r(z))^ and E(r(z))^ with 
z = u + iv and v > M/ ^Jn for some constant M. This turns out to be quite challenging 
when V is of the order n~^/^. The best order obtained so far is E|r(z)p < M{nv)~'^\z + 
c — 1 + 2zcm{z)\~'^ , or M/{n'^v^) (see Proposition 6.1 in [I^). Roughly speaking we 
establish 

^ |E(r(z))2| < ^ 



\z + c — 1 + zcm{z) + zcEm„(z)| n'^v'^\z + c — 1 + 2zcm{z)\ 

and 

\^{T{z)f\ < M/{n^v'^). 

To this end, we develop a precise order of n^"'^EtrA^^(z), which is of v^^^"^ . Also, some 
sharp bound for n^^EtrA^^(z)A^"'^(2;) is established (the definition of A^^(2;) is given 
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right before section 3.1). Indeed, these results also imply that the convergence rate of 
E,mn{z) to m{z) is M/{nv) (see Proposition [T]), which further implies 

|lE(r(z))2| < M(nt>)-2. 

We expect that this inequality could be used to solve the universality problem of the 
largest eigenvalue of sample covariance matrices as Johanssan does in [13] • 

3. Finite dimensional convergence of the processes 

Throughout the paper, to save notation, M may stand for different constants on 
different occasions. This section deals with Theorem [H 

Following the truncation steps in p] we may truncate and re-normalize the random 
variables so that 

(3.1) \X,^ \ < r„ni/^ EX,j = 0, EXf^ = 1, 

where TnU^^^ — )• oo and t„ — t- 0. Based on this one may then verify that 

(3.2) EXfi=3 + 0(-). 

n 

Let m^{z) denote the one obtained from m{z) with c replaced by c„. For x G [a,b], 
by Cauchy's formula, with probability one for sufficiently large n, 

(3.3) nh[{Ux) -\j K(^)<m,M)) =-^,l K{^)Xr.{z)dz, 

where Xn{z) = tr(A„ — zT)^^ — nm^(z) and the contour Ci is the union of four segments 
7j, j = 1,2,3,4. Here 

-yi = u — ivoh,u e [ai ,ar], 72 = it + ivoh, u e [ai, Ur] , 

73 = a/ + '''V,v G [-VQh,voh], 74 = + iv,v G [-Voh,voh], 
where ai is any positive value smaller than a, any value larger than b, and vq is a 
constant specified in ()2.9p . 

For the sake of simplicity, write A = A„. We now introduce some notation and 
present some basic facts frequently used in this paper.. Define A{z) = A — zl, Afc(z) = 
A(2;) — Sf^s^ with n^^'^Sk being the A:th column of X„. Let = E(-|si, • • • ,8^) and Eq 
denote the expectation. Let v = Q{z). Set 

= 1 ^^t1~1( ' ''fc^^) = Sfc A-^(z)sfc - ^trA-^(z), 

bi(z) = . , /3?(z) = . 

l + n-iEtrAfi(z)' '^^ ^ ^ 1 + n-itrA'^z) 

Ffc = n-hrA^^z) - n-^EtrA^ ^(z), F^ ^ = n~hiAfiz) - n-^EtrAf{z) 

and 

rjf\z) = slA^\z)sk - n-hTA,\z). 
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We frequently use the following equalities: 

(3.4) A-\z) - A,\z) = -Pu{z)A-\z)suslA-\z)- 

(3.5) h = hi- hMkiz) = bi- bj^kiz) + hlpkiliz) 

where ^k{z) = s^A^^(z)sfc — n~"'^EtrA^"'^(2;). At this moment, we would point out that 
the length of the vertical lines of the contour of integral in (|3.3p converges to zero. As 
a consequence, except |6i(2;)| we can expect neither |/3fc(-2)| nor |/3^'^(2;)| to be bounded 
above by constants independent of v although they are bounded by | (see [2]) (of 
course f 7^ in the cases of interest). Instead, the absolute moments of (3k{z) and (3]^{z) 
are proved to be bounded. We summarize such estimates in Lemma [8] in Appendix 1. 
Sometimes we deal with the terms (3^{z) and /3k{z) in the following way: One may 
verify that 

9(1 + n-HrA^i(^)) > vn-hvA,\z)A,\z), 

which implies that 

(3.6) \p'^{z)n-hrA-Hz)A~,H-z)\ < M\v\-\ 
Similarly, 

(3.7) \PkslA-\z)sk\ < \v\-\ 
We shall also use the simple fact that 

(3.8) \\A,Hz)\\ < l/\v\. 

Throughout the paper the variable z sometimes will be dropped from their corresponding 
expressions when there is no confusion. 

Here is the famous martingale decomposition in the random matrix theory, 



trA"^(z) - EtrA"^(z) = ^ (EfctrA"^(z) - Efe_itrA"^(z)) 

k=l 

n n 

= J^(Efc - Efc_i)tr [A-i(z) - A^\z)\ = - ^(E^ - E^^i) [pk{z)sl Af {z)sk] 

k=l k=l 

n 

(3.9) =-5^(Efc-Efc_i)[ln/3fc(z)]', 

k=l 

where the third step uses (|3.4p and the derivative in the last equality is with respect to 
z. We then obtain from integration by parts that 

(3.10) — /i^(^^)(trA-i(z) -EtrA-Vz))(iz 
27ri / h 



1 " /■ — r 

- ^(E, - Efc_i) j> K{^)[\n(3k{z) 

k=i 



I 

dz 



(3.11) = -— y(Efc-Efe_i) I K'C^)\n(^^]dz 
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(3.12) X^(Efc - Efc_i) i K'{^){^]:{z)i^,{z) + efc(z))dz 
k=i 

where the complex logarithm functions can be selected as their respective principal value 
branches by Cauchy's theorem and 

ek{z) = ln(l + /3r(^)%(z)) - Pi'{z)m{z). 

Below, consider z G 72, the top horizontal line of the contour, unless it is further 
specified. We remind readers that v = vq/i on 72. The next aim is to prove that 

(3.13) - Y^iEk - E,_i) J K'{^)ek{z)dz ^ 0, 



k=l 



where i.p. means "in probability". By Lemma [71 we have for m = 2,4,6,8 

(3.14) E{\rjk{z)r\A-\z)) < Mn-"^/^[n-hTA,Hz)A,\z)]"'^\ 
This, together with Lemma [8] in Appendix 1 and (j3.6p . gives 

(3.15) E|/3*=^(z)%(z)|8 = E{\f3'^{ztEiMz)f\A-,\z))) < MM~^ 
Via (IMD, (fXT^ and the inequality 

(3.16) I ln(l + x)-x\< M|xp, for \x\ < 1/2, 
we obtain 

rt|^(Efc-Efc_i) I K'i^)ekiz)I{\P'^iz)vk{z)\ < l/2)d " 



k=l 



n „ 

(3.17) < M/i-2^e| / K'{^)ek{z)m'^{z)r^u{z)\ < l/2)d 

k=i •' 

<Mh-'j2[[ [ \K'{^)K'{^)\{E\{f^j:izMz,))\ 

1.. 1 



xE|(/3f (Z2)r/fc(z2))h'^'d^xidn2l < M/{nv^) 



Note that 

ln(l + P):{z)7^k{z)) = ln/3fc(z) - ln/3*'^(z). 
Moreover 1/3^(^)1 < \z\/v and 

\h{z)\ > (1 + V-^slsk)-^ > (1 + V-^nTn)-\ 

It follows that 

|ln/3fc(2)| <Mmax(ln?;~\ ln(n/i;)). 
Likewise |ln/3^''(z)| < Mlnu"^. Hence 

+ I3)^{z)r]k{z))\ <Mmax(lnt;-\ ln(nr„/v)). 
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This, together with ()3.15p . ensures that 

-e| j;(Efc-Efc_i) I K\^)ek{z)I{\f3'^{z)7ik{z)\>l/2)du < M/{nv^). 

k=l 

Thus, (j3.13p is proven. Similarly, by (j3.14p and Lemma [8] we have 



E 



k=l 

Therefore on 72 

(3.18) 

where 



^ = i^Y.^k{x) + Op{l), 



k=l 



rl 



,x — z. 



Y,{x) = hiz)Ek - I K'i—^)vkiz)dz 



h 



Apparently, Yk{x) is a martingale difference so that we may resort to the CLT for 
martingales (see Theorem 35.12 in [5j). Here we consider only one point x. But from 
the late proof, one can see that we actually prove the finite dimensional convergence. 

As in ([3T71) . by dlJ]) and (l3T5]) we have 

n 

^E\Yk{xt<M/{nv^). 
k=l 

which ensures that the Lyapunov condition in the CLT is satisfied. 

Thus, it is sufficient to investigate the limit of the following covariance function 



1 " 

--2^E,_i[n.(xi)n(x2)] 



(3.19) 
where 



47r2 
1 



k=l 



4/l27r2 



K'i^^\^)K'i^^-^)Cnliz^,Z2)dz^dz2, 



It 

Cnl{zi,Z2) = 61(2:1)61 (22) ^Efc_i[Efc(%(zi))Efc(%(2;2))]. 



k=l 



Note that for any non-random matrices B and C 
(3.20) E(sf Csi - trC)(sf Bsi - trB) 

'^(EXf^ - |EX2^|2 - 2) J(C)ii(B)ii + |EX2j2^-2trCB^ + n-2trCB. 



= n 
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This implies that 

n 

61 (2:1)61 (22) ^Efc_i(Efcr/fc(zi)Efc7?fc(2;2)) 
fc=i 

(3.21) = (EXi\ - 3)6i(zi)6i(z2)4\^(zi,Z2) + 26i(zi)6i(z2)C„2(zi, zs) 

(3.22) = 2hi{zi)bi{z2)Cn2{zuZ2) + 0{l/{nv^)), 
where 



CS(^1,^2) = ^X;^E,(A-i(zi)),,E,(A-^(z2)),> 
k=i j=i 

1 

Cn2{zi,Z2) = ^ J^trEfc(A^^(^i))Efc(A^^(z2)) 

k=l 
n 

= ^E^^M^kHzi)A,Hz2)) 

k=l 

and the last step uses ()6.2p and (|3.8p . Here A^^(z) is defined by si, •• • , Sfc_i, s^_,_i, • • • ,s„ 
as A^^{z) is defined by si, • • • , Sfc_i, s^+i, • • • , s„ with Si, • • • , s„ being i.i.d. copies of 
si and independent of {sj,j = !,••• , n}. 

3.1. The limit of C„2(-2i, 2^2)- The next aim is to develop the limit of C„2(-2i, 2;2). To 
this end, we introduce more notation and estimates. Let 

Akj{z) = A{z) - SfcS^ - SjsJ, (3kj{z) = rl-if ^ ' 



■j ^kj v-y-j 
1 



^''^^^ l + n-iEtrAr2^(z)' ^^^'^^^ l + n-itrA-/(z 
Tkj = n^HrA^/(2) - En-itrA^/(z), rg^ = n-itrA^/(z) - En-HrA^/(z) 

and 

Ckjiz) = sjA^/(z)sj - En-HrA^/(z), 7]kjiz) = sJA^/(z)sj - n-HrA^/(z). 
Actually, they are similar to Afc(z), /3fc(z), • • • . Note that 

(3.23) A-\z) - A-^iz) = -/3fc,(z)A-i(^)s,sjA-i(^) 

which is similar to (j3.4p . and (see Lemma 2.10 of [2j) for any p x p matrix D 

(3.24) |tr(A^i(z)-A^i(z))D| < mv~\ 
Also, we have 

(3.25) |/3fc,|||sjA-i(z)f = |/3fc,sjA-i(z)A-i(z)s,| < v-\ 
Write 

(3.26) Pkjiz) = bi2{z)-(3kj{z)bi2iz)^kj{z) = 6i2(^) - b?2(^)6i(^) + /3fci(^)6?2(^)dj(^)- 
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E\n-hrA~^{z)\^ < M. 



By Lemma [8] we have 

(3.27) En-'^trA-'^{z)A-^{z) = v-^Q{En-'^trA-\z)) < Mv'^, 
which, together with (I3.24|) . implies that 

(3.28) En-HrA^/(z)A^/(z) < Mv-\ 
By Lemma [8] in Appendix 1 and (j3.24p we then have 
(3.29) 

By (j3.24p and the fact that hi{z) is bounded, given in Lemma [HI it is straightforward 
to verify that \hi{z) — hi2{z)\ < {nv'^)~^ and hence 

(3.30) \bi2{z)\ < M. 

In the following, we will use E-' to denote the conditional expectation given si, S2, • • ■ 
except Sj. It is indeed the expectation taken with respect to Sj. And write 

(3.31) center-' (x) = x — K\x), 
where x is some random variable. We claim that 

-1 j;center^(sjA-i(zi)A-i(z2)s,)|' = 0{l/{nv')), 
j>k 



(3.32) 



E 



n 



(3.33) 



E 



n 1 ^centerJ(sjA^/(zi)Aj(z2)sj) 
j<k 



0{l/{nv^)) 



and 
(3.34) 



E ^ ^ center-'' {sjAf^j (zi )sj) 

j<k 

Consider ()3.32p first. Apparently by Lemma [8] we have 



0(l/(nV)). 



(3.35) 

Second, we also obtain 



n-2 J^E|center^(sjA^i(zi)A^i(^2)s,) = 0{l/in\^)). 
j>k 



^ E[center^'^(sJ^A^^i(zi)A^i(z2)s,-J 

(3.36) X center^-^(sJ^A-^(zi)A^\z2)s,,)] = 0{l/in\')), 
which was ensured by the following estimates: 

(3.37) E[center^-^(sJ^A,-i A,is,0 x center^'^ (sj^ A"^ A-^s,,)] = 0; 

(remember the convention that z and z are dropped from the corresponding expressions) 
and via (13.250 . Holder's inequality 

E|center^i (sj^ A(fe, j2, ji)A^ i(z2)sj-J xcenter^'^ (sj^ A(fc, ji, j2)A^ i(z2)sj-,) | < M/(n\^), 
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h kjij2 ^ 



kjij2 ^ 



(A - SfcS^ - Sj^sJ^ - sj^sj^ -zl) \ Pknhiz) = (l + sj^ A^/^^.^(z)sj 
and A{k, ji, j2) and /Sfcju^C-^) ^-^^ defined similarly. Thus ()3.32p is true, as claimed. 

Consider ()3.33p next. Note that (I3.35p . (I3.37P are still true if A^^(z2) is replaced by 
A^j^-^{z2)- Moreover, by (j3.25p . Lemma [71 Holder's inequality we obtain 



E 



center^i (sji A(A;, 32 , ji ) {zi )A{k, j2 , j'l ) {z2)sj, 
X center^2 (s A (/c , ji , j2 ) (^1 ) A ( A; , j2 , ii ) (^2 ) ) 



< 



M 



E 



Is^ A"^ 



i4ii„r 



xE 



s A 



1/2 



where A^^?^^.^ (z) is obtained from A^^?^ (z) with s^+i , • • • , s„ being replaced by s^+i , 



kjlj2 



and the remaining si,-- - ,Sk-i unchanged, f^f^j j^i^) is obtained from Iikjxj2i^) with 
^kj2jS^) replaced by Aj:j^-^{z) and A{k, 32, ji){z) from A(/i:, j2,ii)(^;) with A^^^2^.^(z) 
and f^kjijiiz), respectively, replaced by A^j^j_^{z) and I3^.^.^{z). Here A{k, 31,32) and 
'^fci2j ^^-^ similarly defined. These estimates imply (j3.33p . 

Replacing A^^(z2) by the identity matrix from (|3.35p - p.37p yields (|3.34p . 



Let Un{z) 
(3.38) 
where 



— (1 — n '^)hi2{z)) . We now state the equality (2.9) in [3] 
A^\z) = -Un{z)l + bi2{z)B{z) + C{z) + D{z), 



B{z) = ''^Un{z){sjsJ — n ^1)A 



kj ( 



Ciz) = Y.{Pkj{z) - h2iz)Wiz)s,sjA^liz) 



and 



D{z) = n-%2{z)uniz) Y,{A~^iz) - A,\z)). 



Applying the definition of C{zi) and (I3.26P gives 
(3.39) n-^E4trC(zi)A^H^2)] = Ci(zi) + ^2(^1), 

where 

Ci(zi) = -bl2{zi)n-^^Ek[^kj{zi)sJ A-,^j,^{zi, Z2)sj] 



and 



C2{zi) = bl2{z,)n-'Y.M(^kM)fkji^>JKjki^^^^2)sj]. 

j^k 
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Here 

(3.40) A,^U^i,^2) = A,/(zi)A,i(z2)n„(zi). 

Define Ckj3 = center^ {sj A~ji^{zi, Z2)sj) . 

We claim that the contribution from C{zi) is negligible. To verify it we distinguish 
two cases: j > k and j < k. Consider j > k first. From (|3.29|) and an estimate similar 
to (f3:29|) we have 

(3.41) M(E|n-itrA^/(zi)A^/(zi)|4E|n'itrA^i(z2)A^i(z2)|')'^' < M/v\ 
where we use (|3.24|) as well. It follows from Lemma [H] and (|3.41|) that 

X (Ela.sl" + E|n-HrA^^(zi, Z2)0] < Minv^yK 

As for Ci(zi), write 

Efc[Cfcj(^;i)sjA^^^^(2:i,Z2)Sj] = Efe(?7fcj(zi)Cfcj3) 

(3.42) +Efc(n-irfe,(trA-^^(zi,Z2) -EtrA-/^(zi,Z2))) + Efc(rfc,)n-iEtr(A-^(zi, zs))- 

We conclude from (j3.24p , Lemmas [9] and [8] that the absolute moments of the first two 
terms above on the right hand have an order of \l{nv^\ As for the last term, it was 
proved in Proposition 6.1 of [TO] that 

(3.43) E|n-itrA-i(z) - En-HrA-i(z)|2 < , ^ 

In view of (j2.1|) . we have 

(3.44) z + Cn - 1 + 2cnzml{z) = A/(a„ - z)(6„ - z), 

where m^(z) is obtained from m{z) with c replaced by Cn, On = (1 — y^)^ and 6n = 
(1 + Vc^)^- From (IZTOI) we claim that 

X 1 /■"'■ \K({x-z)/h)\ 1 \K((x-z)/h)\ 

(3.45) - / " ^' < M- / ' ^' dm < M. 

hJai \z + Cn - I + 2cnzm^{z)\ h J V|(u-a„)(6„ 



u 



Indeed, by a change of variables and dividing the integration region into \q\ < 5 and 

fi CC 3j Qi 

~2" 



|g| > 8 with < 5 < min{^^, ^^}, we have 



A, v^|(a„ - n)(6„ - n)| /i A-a, y|0c^^g^^a^J(6^^^^0^r^^ 

f^Jx-ar \/\{x - q- an){hn- {x - q))\ 

1 r^"'*' ad 1 /■"'■ 1 

<M,-/ |i^(g//i + i^;o)|dg+SUp |.^i^(-+roo)|- / < M, 

I^Jx-ar \q\>S IT' Ja, | (u - 0„) (6„ - u) | 
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where denotes some positive constant which depends on x. It foUows from p.43|) . 
(f3^ . (|3r24|) and an inequahty similar to (|3?24l) that 

(3.46) E|i^ ' K{^^)Ek{Tkjn-'Eti{A^I^{zi,Z2)))dui\ < M/{nv^), 

where we also use the fact that \n-^Etv{A~^^{zi, Z2))\ < M/v. 

For handling the case j < k, we define A^j [z) , fi ^.{z) and i^-{z) by 

as A'j^j (z), I3kj{z) and ^kjiz) are defined by 

When j < k, similar to (j3.23p . we then decompose A'^^{z2) as 

(3.47) A,}{Z2) - A^}{z2)sjsjA-^\z2)^^. 

Note that sj is independent of A^j{z2). Apparently, the preceding argument for the 

case j > k also works if we replace A^^{z2) in A'^jf^{zi, Z2) with A^j{z2)., the first term 

of (j3.47p . because the preceding argument used the independence between A^^(z2) and 
Sj when j < k. For another term of C2{zi) due to the second term of ()3.47p . by (|3.25p . 
(I3:29]l and Lemma [8] 

^Pkj {Zl )^^. {Z2)fkj (^)sj {Zi ) A-/ (Z2)sj sJ A-/ {Z2)un {zi)sj 

< Mt;-i(E|/3fc,-(zi)|2E|^^.(z2)|']E|6,|'lE|sjA-/(z2)sjn„(zi)|4)'/^ < M/{nv^). 

As for another term of Ci(zi), it follows from Holder's inequality, Lemmas El [U (I3.34p . 
([321]), (13:23]) and <^ that yields 

n-^ Ek [^^^.(z2)6i(2i)sjA^/(zi)A-/(z2)sj-sjA^/(z2)sj-n„(zi)] 

j<k 

(3.48) = n-i ^Efe [^^ .(z2)6j(zi)sjA-/(zi)A-/(z2)s,-n-HrA-/(z2)n„(zi)] + A, 

j<k 

= n-iE(n-HrA-/(zi)A-/(z2)) E4^ (z2)efcj(^i)n-HrA-/(z2)n„(zi)] +^2 



j<fc 



.„(zi)6i2(z2)En'itrA^/(z2)E(n-itrA-/(zi)A-/(z2)) 



x^Efc[%^(zi)+ (n-HrA-H^i) -IEn-itrA-i(zi)) 



+ ^3 



j<fc 

^x„(zi)6i2(^2)En-HrA-/(z2)E(n-HrA-/(zi)A-/(z2)) 



X 



(1 - /c/n)Efc(n"HrA"^(zi) - En~HrA"^(zi)) + A4, 
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where each Aj satisfies < M/{nv'^), j = 1, 2, 3, 4 and the last term can be handled 

as in (13.46p . Summarizing the above we have proved that 



(3.49) 



E 



0.1 



du^ 



< 



M 



Consider D{zi) now. When j > k using ()3.26p and recalling the definition of 
A'^j^{zi,Z2) in (|3.40p we obtain 



ti:D{zi)Ak-\z2 



n 



where 
and 



Di = -n-^Ek[tvA^Uzi,Z2)A^Uzi)Pkj{zi 



D2 = Ek [/3A:i(^i)center^' (sJA^^^^(zi, Z2)A^^^(2;i)sj)] . 

By Lemmas [71 El Holder's inequality and ([3:29|) we have E|i:»i| < M/v^ and E|L>2| < 
y~3/2^ These imply that for j > k 

(3.50) E\n'hTD{zi)Ak'^{z2)\ < M/inv"^). 

When j < k, we resort to ()3.47p . the decomposition of A^^{z2)- As before, the above 
argument for the case j > k also works for the term involving A^j[z2) if we replace 
A^^{z2) with A^j{z2). Another term is 

^'"^''^'E[f^kM)^,,i^2)sjA-l{z,)A-^^ 



ijUniZl . 



which has, via (j3.25p . an order of (nu^) ^ . Thus, the contribution from C(z\) and D(z\) 
is negligible. 

Next consider B{^z\). In view of (j3.32p and (j3.33p we may write 



n 



-1 



trE45(zi)A^i(z2)] = Si(^i) + 52(zi) + ^5 



where 



Si(zi) = -n-i^Efc[^ (z2)sjA-/(zi)A,/(z2)s,sjA-/(z2)s,n„(zi) 



3<k 



B2{zi) = n-2^E4^^^.(z2)sjA,/(z2)A^/(zi)A^/(z2)s,^.„(zi)] 

j<k 

and ^l^sl < By (f3:25|) and Lemma [8] we have \B2{zi)\ < M/{nv'^). With notation 
fjkj = center-' (sJA^^^(zi) A'j^j {z2)sj) , from Lemma [8] we obtain 

E|(%,)K'trA-/(zi) -En-HrA^/(zi))| < M/{nv^), 

which, together with (j3.33p . implies that 

E|n-i (%,-)n-itrA^/(zi)| = 0{n-\-^). 
j<k 



16 GUANGMING PAN, QI-MAN SHAO, WANG ZHOU 

Moreover, in view of Lemma [9] and (I3.34p we have 



E|n-2^trA,7(zi)A,-i(^2)%,| <M/( 
j<k 

Apparently by Lemma [8] we also have 



nv 



^f|kjr]kj\ < M/{ 



nv 



We then conclude from Lemmas [71 [8] and (j3.26p that 

(3.51) |Si(zi) + n-=^6i2(z2)n„(zi)XllEfc[trA^/(zi)A^/(z2)trA^/(^2)] | = Aq, 

j<k 

where E\Aq\ < 

Furthermore by (j3.24p we obtain 



n 



' J^Efc [trA^i(^i)A,-i(^2)trA^H^2) 



j<k 



k-l 



trA,i(zi)A,i(z2)trA^i(^2)l +0( 



nv 



2'' 



It follows from Lemma El ([3:i3]) and ([OS]) that 

-k-l 



trA-i(zi)A-i(z2)trA^i(z2) 



-EtrA, i(z2)Efe \^iTA^\zi)A^\z2) 



n 



\K{—-^)\E\A7\dui < 



0.1 



h 



where 
(3.52) 

We then conclude that 

(3.53) Bi{zi) + 6i2(z2)n„(zi)n-iEtrA-i(z2)^^Efc 



nv^ 



trA-i(^i)A-i(^2) 



where A^ satisfies (I3.52p with A-j replaced by Ag. 

Summarizing the argument from (j3.39p to ()3.53p yields 

(3.54) n-iEfc[trA-^(zi)A-i(z2)] = -n-iu„(zi)Efc [trA-i(z2)] 

-Un{zi)bi2{zi)bi2{z2)n-^E{tiA-\z2)) [^^Efc (tr A^ ) A^ ^ (^2))] + ^9, 
where A^ satisfies (|3.52p with A-j replaced by Ag. 

n 

By the formula ( see (2.2) of |2T]) ELni^) = —z~^n~^ ^ Pk{z), we have 

k=l 

(3.55) E/3i(z) = -zEm^{z) 
It follows from (13. 5p and Lemma [8] that 

|E/3i(z) - hiz)\ = |6i(z)2E(/3i(z)e?(z))| < M/inv) 
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(3.56) \bi{z) -bi2{z)\ < M/{nv). 
These, together with (|5.12p below, imply that 

(3.57) \bi2{z) + zm^{z)\ < M/{nv). 
This, along with (|2.5p . ensures that 



(3.58) 



ra"^EtrA"^(z) 



lwT + 0(— ) 



z + zm^(z) nv' 
We then conclude from (f334]l . dSST]), (|338]l . Lemma [8] and (I5l2]) that 



(3.59) 



trA,-i(zi)Efe(A,-i(z2)) 
^n(^;i,^;2) 



1 On{Zi,Z2) 



n 



+ A 



10, 



2^1^2121° (^i)l2i° (^2) 
where vlio satisfies ()3.52p with A^ replaced by ^10 and 

c„m°(2;i)m°(2:2) 



hn{zi,Z2) 



(l + m0(zi))(l + m0(z2))- 



From (2.19) in [3] and the inequality above (6.37) in we see that 



(3.60) |1 



k-l 



n 



bnizi,Z2)\>Mv, \l-tbnizi,Z2)\>Mv, for any tG[0,l]. 



It follows that 

n 

(3.61) 

Similarly we have 



n ^'^i'^-- — -bnizi,Z2)) 

k=l 



-1 



'1 - tbnizi,Z2)) ^dt\ < 

nv 



\n ^y^(l-|^ — -bn{zi,Z2) 

k=l 

Moreover from Lemma [8] and (19. Ih 



/ {l-tbnizi,Z2)y^dt\ < 



(1 - t\bn(zi,Z2)\) ^dt = \bn(zi,Z2)\-^ ln(l - |5„(zi, za)!) = 0(ln 1/v). 
It follows that 



(3.62) 



n 



-'Ell 



yt- 1 



6n(^i,^2)r' = 0(lnl/t;). 
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We conclude from Lemma El ([339]) . (fHIHT]) and that 



flnl (21,^2) 



bn{zi,Z2)n ^ ^ (1 



^-bnizi,Z2)) ^ 



k=l 



n 



An 



(3.63) 

where An and A12 satisfy 
(3.64) i 



bnizi,Z2) {1 - tbn{zi,Z2)) ^ dt + A12 

Jo 

-ln(l - 6„(zi,Z2)) +^6 

-In ({zi - Z2)mn{zi)mn{z2)) - ln(m°(zi) - m^{z2)) + vli2, 



,x — z-i , , , M In l/i; 



1; 



h ' nv 

and in the last step one uses the fact that via (|2.5 

m^{zi) - m^{z2 



zi - Z2 



(1 - 6„(zi,Z2))- 



So far we have considered G 72, the top horizontal line. The above argument 
evidently works for the case of 2; G 71, the bottom horizontal line, due to symmetry. 

To deal with the cases when z belongs to two vertical lines of the contour, from 
Fubini's theorem and (12. 9p we obtain for j = 0, 1, 2. 



h 



X — u 



+ iv)\dv 



du 



h 



X — u 



+ iv)\du 



dv < 00. 



This implies for u £ [ai,ar] 



(3.65) 



\K(j\^^—-^+iv)\dv<oo, j = 0,1,2. 
h 



We also need the estimates (1.9a) and (1.9b) of [3j, which hold under our truncation 
level. That is 

(3.66) P(||A|| > /ii) = o(n-'), P(A^i, < ^2) = o{n''), 
for any /xi > (1 + -v/c)^, /X2 < (1 — Vc)'^ and /. This implies that 

(3.67) P(||Afc|| > /ii) = o(n-'), P(A^f^ < ^2) = o(n-'). 

Select a sequence of positive numbers e„ satisfying for some /3 G (0, 1), 

(3.68) Sn 10, en>n-^. 

Then, as in [3], we introduce a truncation version of Xn{z) on the top half parts of the 
two vertical lines of the contour as follows: 



Xn{z) 



Xn{z) for u = ar, ai,v £ [n ^en,voh] 

Xn{ar + in~^en) for u = aj.,v £ [0, n~"'^e„] 
^Xn{ai +in^^en) for u = ai,v e [0,n"^e„] 
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(one can similarly consider the bottom half parts of the two vertical lines). It follows 
that with probability one 



/ 



,x — z , 



1 1 



K{—-){Xn{z) - Xn{z))dz < Mheni^— + T —) ^ 0. 

Indeed, there is an extra h above on the right hand which is needed in the proof of 
Theorem [TJ 

For Xn{z) on the two vertical lines 72U74, (|3.1ip is still true because there are at most 
finite number of points where the derivative of the corresponding truncation version of 
/3fc(z) do not exist. Moreover, for the truncation versions, the higher moments of A~^(z), 
[z) and A^^. {z) are bounded by (I3.66P and (I3.67P (see (3.1) in |3]). As pointed out in 
the paragraph below (3.2) in l3|, the moments of j3i{z) , I3i2{z) , fi^"^ {z) , {zijTA^^ {z2)si 

are bounded as well. Using these facts, all the estimates holding for z G 71 U 72 also 
holds for the case where z G 7,. U 7/ . Note that the length of the vertical line is at most 
h. Via these facts, the arguments of the case z G 7i, two vertical lines, can follow 
from those of the case 2; G 71 U 72 (here we omit the details) and hence their limits have 
the same form as (I3.63p . 

In the mean time, appealing to Cauchy's theorem gives 
(3.69) i^'(^l_il)i^'(^l^)ln ((zi - Z2)rn^{zi)ml{z2))dzidz2 = 0, 

where the contour C2 is also a rectangle formed with four vertices ai — e ziz 2ivoh and 
Or + e ± 2iv()h with e > 0. One should note that the contour C2 encloses the contour Ci. 
Thus, in view of (j3.63p . it remains to find the limit of the following 

(3-70) - ^ f / K'(^l_il)i^'(^l_ii) ln(mO (zi) - rnS,{z2))dz^dz2, 

which is done in Appendix 2. 

4. The convergence rate of Em„(z) to m{z) 

The aim of this section is to develop a sharp order for EF^ and EFf which are crucial to 
the establishment of Theorem [1] with the stringent bandwidth restriction. Throughout 
this section, let z = u + iv with u G [o, b] and v > Mi/y/n where Mi is a sufficiently 
large positive constant. 

We begin with a series of Lemmas. 

Lemma 1. Let 

g{z) = z + c„ - 1 + zcnniniz) + ZCnEniniz), 
where rn^lz) stands for the one obtained from m{z) with a replaced by Cn- Then 

(4.1) \g{z)\ > CnV^l2^n-hTA-\z)A-\z)) = CnlJ2^[E{n-hvA-\z))] 
and 

(4.2) \g{z)\ > MV^, 
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where < /U2 < (1 — -i/c^)^- 

Proof. It is straightforward to clieck that 

(4.3) 9(z + Cn - 1 + ZCnm^{z) + ZCnmniz)) >V + CnVXmm{A.)'n~^tTA~^{z)A~^{z). 

Write 

g{z) = z + Cn-1 + zCnwPn{z) + zc„E [m„(z)/(Z))] + zc„E[m„(z)/(D'')] , 
where the event D = (Amin(A) < ^12)- Then (gj]) fohows from (gS]) and dMS]). By 

(4.4) |z + c„ - 1 + 2zc„m°(z)| > M^?^. 
On the other hand, it is proved in (6.109) of [lOj that 

(4.5) |Em„(z) - s{z)\ < < pi^, 

where p\ is sufficiently small. We then conclude from ()4.4p and (j4.5p that (|4.2p holds. □ 
Lemma 2. 



(4.6) |Era-itrAf2(2)| < M/\/^, n^^ ^ | (En~HrA-i(z)A-i(z))^| < M/t;, 

fc=i 

(4.7) y |En-itrA-2(^)A-i(z)| < 

^ ^ ^ ^— ^ ^' - t;|z + c„-l + 2zc„m0(z)|' 



fc=i 
n 



(4.8) n-^ ^ |En-HrA^^(z)A^i(z)En-HrA^2(^)^^i(^)| < Mv'^I"^ , 

k=l 

and 

Tu- 
rn \{ng[z))-^Y.^n-hrAf{z)Al\z)\ < 



v'^\z + Cn - I + 2zCnm^{ 



Remark 3. From the derivation of ^.9\ ) we see that the left side of the inequality of 
lji4-9^ multiplied by g{z) is still less than the right side of the inequality. 



Proof. Consider En ""^trA^ ^(z) first. When replacing A^ "'^(-22) by A^ ^{z), the derivation 
in the last section for Efc(n~^trA^^(2:i) A^^{z2)) also works for En~"^trA^^(z) except 
(|3.42p . (j3.48p and the argument starting from ()3.5ip . It is unnecessary to distinguish 
between the cases j < k and j > A; in the current case and so we need not consider 
([M]) . By Lemma H and (f3:26D . <^M\i reduces to 

^ E[/3fc,-(z)efcj(2)sjA^/(z)s,-sjA^/s,u„(z)] 
j 

= n'%2Un{z) [lE(%isjA-/s,n-HrA^/) + E(rfc,-rgyn-itrA^/] + Oin-^^^) 
j<k 

= 0{n-\-^). 
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Moreover, from Lemma El (I3.51|) turns out to be 

Bi{z) + {z)uniz)^E [tr A^/ (z)tr A"/ (z)] 

j 

(4.10) = Bi{z) + bi2iz)uniz)n-^EtrA];^{z)n~^EtiA^'^{z) + 0(n"^^;"2). 
Therefore, as in p.59p . we have 

(4.11) n-'E[tTA-\z)] X [l-6„(z,z)] = +0(n-i^-2), 

where bn{z,z) is obtained from bn{zi,Z2) from p.59p with zi = Z2 = z. From (|2.5p and 
(j2.4p one may verify that 



(4.12) l-6„(z,z) = -(z + c„-l + 2zc„m^(z)) 

1 + m^(z) 

It follows from (imi) . KT2\\ . (lO) . (lOll . (l8l^ and Lemma [8] that 

(4.13) |ra-^EtrA^2(z)| < Af/Vw. 

As for the second inequality in (|4.6p . checking the above proof for Kn^^trA^'^{z) and 
the last section for Efc(n~^ trA^^(zi)A^"'^(z2)) and referring to (j3.59p we have 

(4.14) n-iE[trA,iA,i] x [l - ^6„(z,.)] = j^^^ + 0{n-\~'). 
As in ()3.6ip and ()3.62p we obtain 



iV(l-^|6„(z,z)|)"^ = / {l-tK{z,z)\r^dt + 0{^) 

JMipL + o(^) = 0(i) 

1 — \bn\z^ z)\ nv^ V 



n 

k=l 



It follows from (|4T4l) and KTEh that 

n 

(4.16) ^ |(En-itrA, i(z)A, i(z))2| = 0(^-1) 



fc=i 



Consider (14. 7p next. The strategy is to use (13.380 . From (13.250 and Lemma [8] we 
obtain 

^n-hrA,'A,'Diz)] = '-^2^±E[sjA~^^^^^ 



n 

3^k 



Apply (lOGjl and ([3:23]) to write 

n 

(4.17) E[n-HrA, ^A^ iC(z)] = n-in„(z)6i2 J]E[(efc,- + /3i2(efcjf )sJA,/ A^ ^ A^ ^s, 
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n ^-^ n ^-^ 

j<k j>k 

where 

Cs = E[r?fc,center^(sjA^iA,7A^is,) + Tk.in-hvA^^A^} - En-hrA,fA,})] 
C, = E[efc,(sjA,7A,7s,)%] , C, = E[CkAsjA-}A,ls,fsjA-ls,f^,j^^.] , 
C, = E[e,,sjA,-iA,-iA-is,sjA-is,/3fc,], = ¥.[Pu,{i,,fs] A-jA~^A-js,] 
Cs = E[/3|^.(C,,)'sjA,-iA-iA^is,sjA^^s,] , 

and 

C, = E[/3fc,efc,sjA^iA,^A^is,], Cio = E[/32 .^,,sJA^1A, Ia^Is^sJa^^s,-] . 

It follows from Lemmas El (H (|3:26D . (|3:23]1 and (13:25]) that \Cj\ < M/v,j = 3, 6, 7, 8, 9, 10 
and 

C, = {En~hiA^\z)A^\z)fCji + 0{v-^), j = 4,5, 
where \Cji\ < Al/y/nv. Therefore 

(4.18) E[n-hTA^'A,'C{z)] = {En-hrA,Hz)A,\z)fA,3 + 0{v~\ 

where | ^13 1 < M/ yj-mj. 

Next we use (l3:26]l and (l3:23]l to write 



E 



n 

n-HrA^iA^iB(z)] = n-iu„(z) ^ E [center^' (sJA^/A^IA^^sj 



n ^ n ^ 

j<k j>k 

where 

^3 = E[(sjA-iA-is,)% - n-hj A-} A-fA-^s,P J 
B, = E[{s]AljA-js,fs]Aljs,p_^^P,, - n-'sjA~^A-}s,sjA-}A,}s,^^^P,,] , 
B, = -E[sjA-lA,lA,ls,sjA-}sjP,, - n~hj A^fA.^ A,} s,^,,] 

and 

Be = -E(sjA-iA^iA^is,sjA^^s,/3fc,- - n-'sjA^^A^^A^Is^p,^). 
In view of Lemmas El [3 IK26h . and (l3:25]l we have 

Bj = {En~hr A-^A-^ fBji + Oiy-^), j = 3,4, 
where \Bji\ < M and 

Bj = -6i2En-HrA^ ^E(n-HrA^ ^A^ 1) + 0(t;"^), j = 5, 6. 

Thus 

(4.19) E(n-HrA^iA-i5(z)) = (E(n-HrA-iA-i))'Ai4 

-6i2n„(z)En-HrA^^E(n-HrA^ ^) + 0{v-^), 
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where |^i4| < M. 

Note that the coefficient of E(n-HrA^ ^A^ ^) in (I4l9]l is the same as thatofEn^HrAr 
in (I4.10p . Summarizing the above we have thus obtained 
(4.20) 

En-HrA^2A^i(l-6„(z,z)) = -u^En-^trA^ ^A^ ^ + (En-^trA^ ^A^ i)^^i5 + 0(^;-i), 

where \Ai^\ < M. This, together with (j4.6p . imphes (|4.7|) . 
As for (l48l) . in view of (j4.20p we have 

(4.21) (1 - 6„(z,z))E(itrA-2A-i)E(n-itrA-iA^i) = ai(z) [E(n-itrA^ ^A^ i)] ' 

+a2{z) [E(n-itrA^ 1 A^ 1)] ^ + a3(z)E(n-HrA^ ^ A^ i), 

where |ai(-z)| < M, |a2(-2)| < M and |a3(z)| < M/v. Moreover we conclude from (|3.60p . 
dUS]), (liTHD and Lemma □ that 

(4.22) = {l-\hn{z,z)\)-^ + 0{v-^) = 0{v-^). 

Then gSD follows from (l4T4]l . g2Il), (022]), and (l4T2]l . 
To establish (j4.9p . we observe that Lemmas [T] and [8] imply 

(4.23) |En-HrA-^(2)A"^(z)|/|c/(z)| < M/w, 
^n-'^iIA-'^{z)A-^{z)f/\g{z)\ < M{v%{z)\)-^[E\T\^ + \'^{^n-hiA^^)\^] 
<M/^>^ A: = 2, 4, 8. 

This key fact implies that whenever 

En-HrA-i(2)A-i(z) and E|n-HrA-i(z) A-l(z)|^ /c = 2,4,8 

appear, dividing them by \g{z)\ does not change their original sizes. As consequences 
of this fact, applying (I4.23p and (I3.24p then ensures that (18. ip and (18. 2p are still true 
when we divide the expectations in them by 15(2) |. For example, by ()4.23p and p.24p 
we have for m = 2, 4, 6, 8 

(4.24) \g{z)\^^¥.\rikjr < M {n"'/'^\g{z)\y^E\n~hrA-\z)A-\z)\f 

We also provide an argument in Lemma [9] for (j8.ip when the expectation in it is divided 
by diz)- Moreover by (j4.23p and (I3.24p one may verify that the first three conclusions 
of Lemma [9] are still true when the expectations in them are divided by \giz)\ as in 
the last claim of Lemma [9l From now on until the end of this lemma we mean the 
corresponding expressions divided by \g{z)\ whenever we quote (j8.ip . (|8.2p and Lemma 

El 
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Now we resort to use again. From and Lemmas [8] and [D 

we have 

n 

\g{z)\-'\E[n-hTA,'A,'Diz)] \ < M{v\'\g{z)\)-'Y.E{\\sjA,^^^^^^^ 

n 

< M{v'n'\g{z)\)-'Y.[En-hTA-l{z)A-\-z)^^^^^^ < M/v\ 

where || • || denotes the spectral norm or Euchdean norm of matrices or vectors. As in 
and by (HH), ([321]), (EJD, (l3:26D and Lemmas O [8] one may verify that 

g(z)-iE[n-HrA^2A-iC(z)] = (En-HrA^^ A^i)'^i6 
+E(n-HrA^ ^A^ i)E(n-HrA^ ^Afc 2)^^^ ^ 0(1-"^), 

and that 

g{z)-^W.[n~hrAfA-^^B{z)\ = (En-HrA^^ A^1)'Ai8+ 
E(n-HrA^iA^i)E(n-itrA^iA-2)^i9_6i2n„(2)En-HrA-iA-iE(n-itrA-2A^2)+0(7;-2), 
where l^iel < M, \An\ < M/^/nv, \Ais\ < M/^/v and \Aig\ < M. These imply that 
g{z)-'Ein-hvAfAf){l - bn{z,z)) = -Un{z)g{z)-^K{n-hTA-^^Af) 



+ (En-HrA^iA^ 1)^^20 + E(n-itrA^ ^A^ i)E(n-HrA^ ^ A^ ^^^^i + 0{v-^), 
where |^2o| < M/^ and |^2i| < M. Thus (j43|) follows from ([46]), (HZ]) and ([48]) 



immediately. 


□ 


Lemma 3. 




(4.25) 


E|efA^i(z)ej -EefA^^(z)ejf < M/{nv'^), 


(4.26) 


E|efA^2(^)g_Eef A^2(^)g^.|2 < ^/(nw^), 


(4.27) 


E|ef A];^(z)e, -Eef A];\z)ei|^ < M/(nv^) 


and 




(4.28) 


E|ef A^2(^)g. _ Eef Af2(^)g.|4 < ^/(^^e^^ 


where ej is i/ie p- 
6ein5 zero. 


■dimensional vector with the i-th coordinate being 1 and the remaining 


Proof. Consider i 
(j3.26|) write 


i = j first. Let $i(z) = ejA^^{z)ei - EejA^^{z)ei. By (j3.23D and 


<I)i 


(z) = X;(Efe-E,_i)(ef(Ar^(z)-A-,i(z))e,) 

k=2 


(4.29) 


P 

= - ^(Efc - E,_i)(s^A-,i(z)e,ef A-,i(z)sfc/3ifc). 

fc=2 
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Let 



lke = lrke-n ^ef A-^^^ {z)ei, 7rfce = A^^^(2;)ejef A^^^(z)sfc. 



From Lemmas [7| and [8] we obtain 

nirkeM' < M(E|/3ifc|8)V2(E|^,^|8)i/2 + M {E\M^)'/\E\n-' ej A'^ {z)e,\')'/^ 

(4.30) < M(nV)-^(l + (E|$i(z)|^)i/2), 
where we also use the facts that 

ef A-i(z)A-i(z)e, = v-'Q{ef A-^{z)e,) 
and that via ()3.23p , Lemmas \7\ and [8] 

(4.31) E|ef A-i(z)e, - ef Ar^(z)e,|^ < M{nv'^)-\ 



By Lemma [71 estimates similar to (13. and ()3.14p we have 

2 M 



Trfce 



E 



fc-l 



7rfce(/3rfc)^??ife < ■^(Ek.i\ejA-^{z)ei 



M 



Ik ' 

1/2 



tr |4 



Efc-il/^ffc 



1/2 



and 



7rfce/5lyt(/3rfc)^r/2;^ 



< ^Efc-1 



Efc-i 



1/2 



tr 1 2 



Efe-il/^ffc 



1/2 



These, together with = - (/SfJ^r/ifc + /3u.(/3*p^r/f;,, imply that 



2 M 



(4.32) Efc_i7^fce/3ifc < ^(Efc_i|e/A-^(z)e 



1/2 



tr |4 



1/2 



+ 1 



It follows from (j4.30p . (|4.32p . (j4.3ip . Burkholder's inequality and Lemma [8] that 



k=2 



IrkePlk 



2\ 2 



lk\ 



k=2 



Solving the inequality yields (I4.27p . 

As for i ^ j, from (j4.27p . (j4.3ip and Burkholder's inequality we obtain 

M „, ^ . _i _ ,o . M 

and 



E|s^A-,H.)e.|^ < ^i?|ef A-,i(z)A-,i(z-)e,p < -^£;|ef ArH.)e,p < 



E|s^A-i(z)e,| 



< 



M 



These ensure that 



E\slA-j^{z)eiejA-^{z)sk\^ < M{E\slA^^{z)e,\''E\ejA-^{z)sk\''y/^ < M{n~v 



2„,2\-l 



and 



E\ilklilk^l^lk i^)^i^]^lk (^)Sfc) I 
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< Af(E|s^A-,i(z)e,|SE|ejA-,i(z)sfc|«)i/^(E|eifc|^E|/3ifcni/4 < M{n\^)-\ 
By the above two estimates, ()3.26p and replacing of (j4.29p by we obtain (j4.25p . 
In view of Cauchy's theorem we have 

(4.33) E|ef A~2(2)ej - Eef Aj;2(z)ejf < Mv'"^ sup E|^>l(C)|^ 

cere 

where = {C, : \C, — z\ = v/2}. This, together with (j4.25p . ensures (|4.26p . Similarly 
from we can obtain (f08|) . 

□ 

Lemma 4. 

(4.34) |E(r?i)3| < M/(ntu), 

(4.35) |E[Efc(r?f )Efc(r?f %)] | < M/{nv^), 
Proof. For m = 1,2,3, write 

p 

SfcBmSfc — n ^trBi = ^(X|j — l){Brn)ii + XkjXkj (Bm)ij , 

where Bi, 62,63 are symmetric, independent of s^. A direct calculation then yields 
3 p 3 

(4.36) E [ II {slBmSk - n-HrB^)] = n-'^EiXf^ -^fY^^ill (^-)-] 

m=l i=l m=l 

(4.37) +2n-3(EX3i)2 ^ ^ E[(B„J,,,,( 

Bm,2)i2j2 (Bms )iij2j 

mi,m2,m3 11^12 

(4.38) + 4n-3(EXi\ - 1) ^ ^ E[(B„J,,i,( 

Bm2 ) jii2 (Bm,3 ) 4112 J 

mi ,7712, ma 11^42 



(4.39) +4n-3(EXfi)2 E[(Bi)i,i, (62)^^,2 (B 



3jiii2 I 



(4.40) +8n-3 ^ E[(Bi)i,i,(B2)ni3(B3)i2i3]- 

where each runs over 1,2,3, rrii 7^ mj for any i ^ j- 

Consider E{r]if now. In this case 61=62 = 63 = A^^(z) in (|06]) . Note that 
E(A]'^(z))ii = n-^EtrA^^ (z) is bounded. By Lemma [3] 



(4.41) n-^EiXf^ - 1)' E ^ [ n (^-)-] = 



n 2) 



i=l m=l 
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From Lemma [3] and Holder's inequality we also have 
which implies 

(4.42) (14:371) = 0(n-3/\"^). 
Similarly, one may verify that 

(4.43) (jCT]) = 0(n-2^;-i), (09|) = 0(n~2t,-2). 
This, together with Lemma [3l implies that 

W = 8n-3 ^ E E[(Arn^)k..(ArH^))n.a(Ar'(^))...3] + 0{n-\-^) 

«1 = 1 42 = 1 «3 = 1 
V 

(4.44) = 8n-3^E(efAf3(^)g.) ^0(^-2^-2) ^ ^^^_2^-2)^ 

Thus (fOil) follows from (fOB - (fOID . 
Consider (|4.35p next. Write 

E[E,(r/f )Efe(4')%)] = E[r/fr?f 

where i]"^ = s^A^^(z)sfc — n~^trA^^(2;). In this case Bi = A^^(2;), B2 = A^^(2;) and 
B3 = A^^(z) in (|4.36p . Applying Lemmas [2] and [3] we have 

(4.45) n-3E(X|,-l)3f]E[^(Bn^)n] =0{n-\-^). 

i = \ 771=1 

Similarly one may verify that 

(4.46) (|i:371) = 0(n~3/2^-3), (fCTD = 0(n-2u-3), (ji^OD = ©(n-^t;-^), 
where we use the fact that En^^trA^^(z)A^^(z) < As in (j4.44p we obtain 

V 

(lOOD = 8n~3 ^E(ef A-2(2)A-3(z)ei) + 0(n-\-^) = ©(n-^t;-^). 

i=\ 

These imply ([435]) . □ 
Lemma 5. 

71 

n-2E(trA~^(z) -EtrA-i(z))^ = n-^6?(z)^E[trA^^(z)A^2(z)] +0(n~\~2). 
Proof. Write 

(4.47) /3k = /3l'-/3k/3l'm{^)- 
Let 

Uk = (Efc -Efc_i)(^fcS^A-2(z)sfc). 
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Applying ()4.47p twice and referring to (13. 9p we then have 

n n 

E[tTA-\z) - EtrA-l(^)]' = ^E{ukf = ^^^{qi + qi + + q4 + q5 + Qe), 

k=l k=l 

where 

gi= [Efc(/?*^r/f )]^ q2=[{Ek-Ek-i){{f^'f:fslAf{z)skVk)]\ 
93 = [(E, -E,_i)(/3,(4'-)2s[A-2(z)sfcr,2)]2 

q, = -2(E, -Efc„i)((/3*'-)2s^A^2(^)g^^^)(jg^ _g^_^^(^^(^tr)2gTA-2(^)g^^2)^ 

and 

qe = 2Efc(/3rr?f ) (E^ - E^-i) [mkf^K^i^^kvl)- 
It follows from ([3^1) and (f3T3|) that 

n n 

\n-^Y.M < Mn-V2^E|(/3*^)2r?2(^)|2 < M/{nW). 

k=l k=l 

Similar to (j3.15p . one may verify that 

(4.48) E\^j^T]f^f < M/{n\^^). 

We then conclude from ()3.14p . (|3.15p (|4.48p . Lemmas [2] and [8] and Holder's inequality 
that 

EmfslAfizHr^kl' < ME|(/3r)%f 

(4.49) +M|En-HrA^2(^)|4^|(^tr)2^^|4^^^|^trr(2)^^|4<^/(^2^4^^ 

Similarly we have 

(4.50) EmP'fjf4^fiz)sk4\' < M/{n\^). 
In view of (I09]) and (Ii30]) 

E^s = Oin-^v-"^), Eq2 = 0{n-^v-'^). 
As in (lOmi by dMI), (13111), Lemma E] we have 

EmfslAf{z)s,r,l\'<M/{n\'). 
By ([321) and ([3Jl]) we obtain 

(4.51) E\hm^4K\^>k4? < M/in^v'). 
These two estimates, together with (j4.47p and (|4.48p . ensure that 

(4.52) Eqe = 0{n-\-^). 

Write 

(4.53) p'f: = h-biTk + f3l'bliT,f. 
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In view of ()3.20p , ()4.53p , Lemmas [U [2] and [8] we may write 



n-2^Egi = n-%l{z)Y,^[tvA-\z)A-\z)\ 

k=l k=l 

n 

-2n-%l{z)Y,^{n-hrAf{z)A,\z)-n-'EitTA-\z)A,\z)))n] +0{ 



2 -2\ 

n V 



k=l 



= n-%i{z)Y,^tTA,'{z)A,\z)] + 0{n'\~'). 

k=l 

Likewise, by IK2Q\i . ([453]) . (f^Mjl and Lemmas El d and E] we have 

n n 

5^ E(?4 = -2n~%l ^ E [E^ (r?f ) (E^ - Efc_i) {si A-\z)skVk)] + 0{ 



k=l k=l 

n 



-2n~%l Yl ^ Vfe (^f %)] +2n-=^6? J] E [n-^rA, 2(^)n-itrA^ ^(z) A, ^(z)] 

fc=i fc=i 



□ 



Lemma 6. 



^E[(Efc -Efc„i)(/3fcS^A-2(z)sfc)]'| < ^ [E|/3*=^7yf 



n-3|E(trA-^(2) -EtrA-^(z)) | < M/(n\2). 
Proof. A direct calculation indicates that 

n n 

(4.54) E[trA-^(z) -EtrA-^(z)]^ = ^E(ufc)3 + 3 J] ^{ul^Uk^ 

k=l kij^k2 

Referring to the expressions of qi,q2,Q3 in the last lemma we have 

n 

k=l k=l 

+E|(/3*^)2s^A-2(z)s,,%|^ +E|A(/3r)^sXT^(z)s,r?Y] < M/{n%'/% 
where the estimates can be obtained as in ()4.48p . ()4.49p and ()4.5ip . 
When ki < k2, 

When ki > k2 we have 

(4.55) E{uluk,)=E[uk,Ek,{ul)]. 

Here we reminder that the term E,f:^{uf,_^) is similar to E(n^), given in Lemma O except 
that the former is the conditional expectation and the later is the expectation. By the 
expressions of qj,j = 1, 2, 3 in Lemma [5] we may write 

(4.56) Uk2 = -Ufcal + '"fc22 + Uk23, 
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where 

Uk,i = - Efc,_i) {i(3gfsl^Ai^^{z)sk,m2), 

and 

Uk,2 = (Efc, -E,,_i)(/3fc,(4;)2s^^A-2(z)sfe,7?2j, uk,3 = (Efc, -Efc,_i)(4;7fe)- 
We claim that 

n 

(4.57) ^Uk,jEk,{ul)] = 0{n-\-^), j = 1,2. 

Indeed, the estimates for q2,Q3,Q5,Q6 involved in Efc2(w^^) are straightforward by the 
argument from (j4.48p to (j4.52p in Lemma [5] for E(u|). Here and below, qj,j = l,---,6 
are obtained, respectively, from {qj} in Lemma [5] with k replaced by ki. To deal with 
qi, from (|4.48p and ()4.50p we see that 

n 

ki^k2 

As for Mfcjij (|3.20p and Lemma [3] first to obtain 

(4.58) Ek-i{{f^l'f^kVk) = Ek^,{{(3l'fn-hTAf{z)) + 0{n-\-^). 
By dSJO]), (I3:2i]l . lira]) . (I09I1 . Lemmas O El [9] and [2] we then have 

E[nfc,iEfc,(gi)] = n-iE[^.fc,iEfc,(4=;^;;n-HrA^2(^)^,2(^))] + 0{n-\-^) 

= ^"'E[^,,iEfc,(/3r^,^^;;^^n-itrA,-2^^(z)A,-l,^(z))] + ©(n-ir;-^) 

= n-^E[n-hrA-X{zmi?^k2{^U^^^^ + ©(n-iz;-^) 

= 0(n-2z;-4), 
where we use the fact that via ()3.24p 

(4.59) \n~hrA^^{z)A'^^{z) - n~hrA^^,^{z)A',^^,^iz)\ < M/{nv'). 
To handle ^4, by (|4.50p . (|4.48p and (|4.49p . it is straightforward to check that 

n 

^[uk22Ek,{qA)\ =0(n-V2). 
As for Ufcji, it follows from (|4.49p . (|4.58p . Lemmas [2] and [9] that 

n-iE[nfc2iEfc,(g4)] = n-i6?E[^Xfc,iEfc,(Efc,(7fcjEfc,(7fc,%J)]+0(n-2t;-2) = 0(n-2t,-2), 

where we use the fact that the arguments for (|4.35p are also applicable to E^j (E^-^ (7/^ ) 
IEfci(7fei^fci))- 

Next consider E [ufcasEfcj {u\^ )] . The strategy is to remove s^j from E^^ {u\_^ ) so that 
we make use of the fact that 

(4.60) E[nfc,3lEte«4)] =0 
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by the fact that lifcj 4 is mdependent of with ^^^4 = (Ejt^-Efc^_i)(/3fc2fciS^^A^^^^^(2;)sfcJ. 
To this end, write 

where 

uk,2 = (Efc, -Efc,_i)[(/5fc, -/3fe,feJs^^(A^2(^) _ A-2^^(^))g^j 
Uk^3 = (Efci - Efe,_i)(/3fc2fciSfci(A^i^(z) - A^^2^^(z))sfc,). 

We now substitute Uk^i + 'Ufei2 + ^fciS + 'Ufei4 for n^^ in E[nfc23EA;2(n^J] and evaluate 
them one by one besides using ()4.60p . By (j3.5p , p.7p , Lemmas [2] and El we have 
(4.61) 

nhAAk^{^>k,\^ < ME\jk,f+M\n-^EA-^{z))f+Mv-''E\Ck,f+Mnrf^f < M/v\ 
and via (fS:^ 

(4.62) +Mn-S-''E|/3fc2fcj4 < Mn-^v'^, 

where Ci(^) = center'^i (s^^A^^\.^(z)sfc2S^2A^^\.^(z)sfcJ. Combining (I4.6ip . (|4.62p and 
(|4.48p we obtain 

E[ufe23Efc2(^^fcii + Uk,2f] = 0(n-2z;-7/2). 
As in (j4.62p one may verify that 

(4.63) E\slA-^\^{z)skAAkki^>k,^k,k,\'' < M/{nv'). 

Thus from gSB), (jMl]), (ICTD . K63\i . ([SJQ]), (l3:25]l and Lemmas [21 El [8] we obtain 

E[tifc23Efc2(lifci3)^] 

= 2E[uk,3Ek,{{Ek,-Ek,-i){^k2k,4iGk,k2{zH,^k,k2)Y] +0{n-\-^/^) 
= 2bi2iz)E[uk,3Ek,{^k^{islGkMz>k, - hrGkM^))h^k2)f]+Oin-\-''/^) 

= 2bu{z)n-^E [nk,3^k, {f3k,kAAkL i^)^kL i^>kJ,^k,^lAk^, 

+0{n-\-''^) = 0{n-^v-^), 

where Gk^k^iz) = A^^^^{z)sk.,sl^A-^^^{z). In view of (|OT]l . (i02]l and (liliH]) we also 
conclude that 

E[ufc23Efc2((ufc,i + Ufci2)^^fei3)] = 0(n~^t;~^), 
because via (gSSl), (|i:62D and (iroil 

(4.64) E\/3k,k,sl{A^^iz) - A,"2,^(z))s,, ^ < m. 
Likewise, by (jMl]), dilM]) . dOH]) and dilM]) we have 

^[uk23Ek2{Uki2Uki4)] =0{n~^v~^). 

Moreover by ([33]), (jMB), (13:201) and we have 

E[ufc23lEfc2(^ifcil'Ufel4)] 
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= n-XE[{Ek,-Ek,-^){/3k2kAAk^2(')^'^M2^^^^^^^ 

xK,4)] + 0{n-\-'') = 0{n-\-''), 

where 

Pk,k2 = centeT''^{sl^A^^^^{z)sk,sl^A^^^^{z)sk,) 
and we also use the fact that 

(4.65) E[uk23^k2{{^k^ - Ek,-i){(3k2k,n-^sl^A-^^^{z)sk,sl^A-^^^{z)sk,)uk,A)] = 0. 

As for E[ufc23Efc2('Ufe-^3nfcj4)] , on the one hand, using p.20p twice and Lemma |8] we 
obtain 

E[uk,3Ek,{{Ek, -Efc,_i)(6i2S^^A-\^(z)sfc2S^^A-2^^(z)sfcJnfci4)] 

= K[uk23^k2{{^k, - Ek,-l){h2P^^j^,)uk,4)] 

= n-^bl,E[{Ek, - Ek,-i){slA-^\Ek,{A,^,JA,^,^Sk,)uk,4] + 0{n-\-^) 
= n-%l,E[{Ek, - Efc,_i)(si'^ A~\^Efc2(A-2,JA-2,^SfcjE,,(7fc2fcJ] + 0{n-\-') 
= n-363^E[n-HrA-/,^E,2(A-f,^)A-2,^E,,(A-2,J] + Oin-\-^) = 0{n~^v''), 
where we also use an equality similar to (I4.65P , 

pfL = center'=2(s|;A-2^^(z)sfc,s|;A-\^(z)sfc2) 

and 

7fc2fci = center''! (s^^A-2^^(z)sfc J. 
Similarly one may verify that 

E[ufc23Efc2((Efc,-Efc,_i)(/3fc,fc2sf'^A~/^^(z)sfc2si2A^2^^(z)sfcjEfc,(7fc2fc,6i2))] = 0{n-\-^). 
Moreover by Holder's inequality, (j4.48p . (|4.63p and Lemma [8] 

E[7ifc23Efc2((Efc^ -Efc^_i)(fei2/3fcifc2Cfcifc2sriA-\^(z)sfc2S^2A~2^^(z)sfcJ 

x{Ek, -Ek,-i){bi2l3k,k2Ck,k2)] =0{n-\-^). 
Via (I3.26j) . these ensure that 

E[uk^3Ek^{{Ek, -Efcj_i)(/3fe,fc2S^^A^^\,^(2)sfc2S^2A^2^,^(2)sfcJufc,4)] = 0{n-^v-'^). 

On the other hand, apparently from Holder's inequality, (I4.61j) . (I4.62p . (I4.63p . (j4.48p 
and p.lSp we obtain 

E [ukA ((Efci - E,,_i) {I3l,^ {si A-^l^^ {z)sk,fslA-^l^ {z)sk, ) 

x(Efc, -Efe,_i)(/3fc2fci/3fc;fc,%2fciS^^A-2^^(z)sfcJ] = 0{n-^v-^). 
Similar to (j4.36p we obtain 

(4.66) Ek, [EkAPk2kA,k2^l2'^kL('>^l)^kM,k2^k2k,)] 

p 

= n-'^/^lEiiXf, - lfXu]Y.Ek,{{BlUB2hy^) 

i=l 
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where 



We obtain from Lemma El Lemma [3] and Burkholder's inequality 

E\f3k,kM^k^,^^)Y < M{E\Pk,k,WkA-^\^e,n^/^ < M/{nW). 

Similarly 

(4.67) E\h,kM^ < M(E|A,,,|SE|/3r,fe,s^^A^2^^e/)V2 < M/{nv^^l^). 

These, Lemma [3] and (|4.48|) imply that 



IE[^te3n-^/'^E,,((Bi)n(B2)iiyO] = 0{n-\-^). 
1=1 

Note that 

^Y.^l2KlkM^2)n+'^~'''^ (Bi)ii(B2)jijiyn. 

By Lemma El Lemma El and Burkholder's inequality we also have 

(4.68) E\h,kAKk^^\^ < M(E|/3fc,fc,|8E|s^A,/,^e,|8)V2 < M/(nV) 

and via (lOHl) . IKEh 

E\/3k,kAAkLEkAf^lkAkL>k,f^Mv-'E{\^^ 

< Af^;-^(E|/3fc,fc,|«E|(/?l^^,j2^,,A,-2^^(z)A,-2,^(z-)s,J«)^/' < M/v'' 
These, together with ()4.48p . Lemmas E] and El ensure that 

IE[ufc,3n-'/' Y {^i)ij{B2)j,j,yi,] =0(n-V^). 

This argument also works for the remaining terms in (j4.66p so that 

E[?ifc23 X = 0(n-2t.-4). 

As in (j3.20p . a direct calculation, together with (|4.68p . (j4.48p and an estimate similar 
to dMZI), yields 

E [uk^sEk^ {Ek^^i{pk.,krf3l,k2^lAkik2 (^)Sfei (^ite^fcifca ))] 



n-^/'E{Xf,-X^^)j2^y'k23Ek,{Ek,-l{(3lk2(^^^^^ 
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These ensure 
Hence 

E[Mfc23Efc2(nfc^3iifcj4)] =0(n"^f~^). 
Thus the proof is completed. □ 

5. The limit of mean function 

The aim in the section is to find the limit of 

^ ^ Ki^^)niEmniz) - m^Jz))dz. 

It is thus sufficient to investigate the uniform convergence n/i(Em„(z) — m^(z)) on the 
contour. In order to establish Theorem [T] we instead apply the estimates in the last 
section to investigate n(Ern^{z) — m^(z)). 

Write 

n 

A — zl = SjsJ — zl. 

i=i 

Multiplying both sides by A^^{z), taking the trace and dividing by n we obtain 

1 " 

(5.1) Cn + ZCnniniz) = I ^/3j(z) 

(one may see the equality above (2.2) of [21]). Taking expectation on both sides of the 
equality above and applying ()3.5p we have 

(5.2) c„ + zc„Em„(z) = 1 - b{z) + b{z)Dn, 
where 

Dn = E (z) (sf (z)si - En-hiA-^z))] . 
On the other hand, it follows from (j2.2p and Lemma [7] that 

(5.3) Cn + zcnm^^{z) = 1 - (l + c„m°(z))"\ 
Taking the difference between (|5.2p and (|5.3p . along with (|5.3p . yields 

(5.4) n(Em„(z) - m° (z)) = nZ)„/(c„5(z)) , 
where g{z) is defined in Lemma [TJ 

Considered z G 71 U 72 first. Applying (j3.5p and (j3.4p yields 

E(trA^^(z)) -E(trA^i(z)) = E(/3isf A^^^^^^^-j 
= 6iE([l - 616 + biMl{z)ViA-^\z)s^) 

(5.5) = 6iEn"HrAj;^(z) - d„i + d„2 + d„3, 
where 

d^i = 6?E[77ir/f)], d„2 = 6fE[risf A^2(^)g^] ^ hlElTiVf^], dn3 = biE[p^eisJ A^si]. 
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It follows from (I3.25|) and Lemma [8] that 

\dnj\<M/{nv^), j = 1,2,3, 

which implies 

(5.6) E(trAf ^(z)) - E(trA-i(z)) = ftiEn^HrA^^^^) ^ 0{n-^v-'^). 
Next by (US]) 

(5.7) nE[/3isf Af^(z)si] - E(/3i)E(trA^^(z)) 

= -nhl¥.[iis{Al\z)si\ +n62E[/3iefsfA^H^)si] -ft?IE(/3ie?)E[trAr^(^)] 

= fnl + fn2 + /n3 + /m, 

where 

/„i = -nblEr]l /„2 = -n6?E(risf Ari(z)si) = n6?E(ri)2, /„3 = n62E(/3iC??7i) , 
and 

/„4 = fe? [E(/3ie?trAr^) - E(/3ie?)EtrAr^] . 

By (I3:20]l we have 

(5.8) fnl = -nblErjl = -26?En~HrA^2 ^ o(n"^7;"2)^ 

By Lemma [5] and (j4.9p 

(5.9) fn2/g{z) = 0{n-\'^\z + c„ - 1 + 2zc„m0(z)|-i), 
where we use the fact that via (|4.4p and (|4.5p 

(5.10) |(7(z)| > Mslz + c„ - 1 + 2zc„m0(z)|, Ms > 0. 

Consider /„4 next. Apply ()3.5p to further write /„4 as 

/ra4 = /n41 + /n42 + /n43, 

where 

/n4i = n6?E(7?2ri), /„42 = n6?E(ri)3, 

and 

/n43 = -fe?[E(;Si^?trAri(z)) -E(/3ie3)E^^Ar^(z)]. 
By Holder's inequality and Lemma [5] we obtain 

|/„43| < nM(E|/3i|2E|e?ri|')'/' < M/{nv^). 

From p.20p , Lemmas [3] and [8] we conclude that 

/„4i = 26?E(rirp)) + 0{n-\-^) = 0{n-\-^). 

In view of Lemma[6]we also have /„42 = 0{n^^v~'^). Therefore fni = 0{n^^v^'^). 

By (|3.5p fn3 may be further written as 

fn3 = fnSl + /n32 + /7i33) 

where 

fn3i = nblE{rjf), /„32 = 2n6?E(r?2ri), /„33 = nblE{Pif^m). 
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Note that /„32 = 2/„4i. Lemmas [8] and H] ensure, respectively, fnss = 0{n ^) and 
/n3i = 0{n'~^v~'^). We then conclude that /„3 = 0{n~^v~'^). 

Summarizing the above argument (particularly (15. 4^ . (j5.6p and (jS.Sp ) we obtain 

(5.11) nDn/g{z) = -(6?/c/(z))En'HrAj;2(z) + 0{n-^v~'^\z + c„ - 1 + 2zc„m° (z)|"^). 



We would point out that (I5.1ip . Lemmas [T] and [2] imply 
Proposition 1. For v > Mj ^/n and u G [a, b], 
(5.12) |Em„(z) - m{z)\ < M/{nv). 



Prom (j4.1ip we have 



(5.13) 



n 



-1 



E[trA^2(^)j 



(l + m0(z))2^ ^• 



z2(l + rriO(^))2V 

We then conclude from ([531, (l5J2]l . (ISTTTl . (liJ2]l . (13371) and ([5331) that 



(5.14) n(EmJz)-mO(z)) 



(l + mO(z))3V (l + rn0(^))2^ 
+0(n~"^t;~^|z + c„ — 1 + 2zc„m^(z) 



The case where z lies in the vertical lines on the contour can be handled similarly as 
pointed out in the last section with the truncation version of X„(z). 



In view of p.45p it remains to find the limit of the following 

1 Ik( ^~^ ^ Cnirnl{z)f , Cn{rrf^{z)f . 
^ ' ATTiJ^ h \l + m§Xz))^^ {l+m^izW' 

which is done in Appendix 3. 



'dz. 



6. The proof of Theorems [3] and \T\ 
Proof of Theorem [3l Let x G (a, 6). We claim that 



nh 
nh 

nh 



h-' / K 



' h 



)dF,„(y)-/,„(x) 



x — a 



h~ 



K{y)fc„{x - yh)dy - fc„{x) 



fcAx) 



x — a 
2h 



x — b 
2h 



+ remainder, 



where 

|remainder| < Anh^[{x — a)~^ + (b — x)~' 

Indeed, by Taylor's expansion 

fcAx - yh) = fc„{x) - fc„{x)yh + fljyx - Qyh){yhf , 



K{y)dy-f,„{x) 

+ ^) J y'^\Kiy)\dy ^ as n oo. 
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where 9 G [0, 1]. Moreover note that 

x — b 

yK{y)dy+ / yK{y)dy < ^nh\{x - ay + {b - [ y^\Kiy)\dy ^ 0, 



x — a 
2h 



nh 



x — a 

1- K{y)dy] <4n/i3((x-a)-2 + (6-x)-2) J y^\K{y)\dy ^ 0, 

h 

and fc^{x — Oyh) is bounded above by a finite constant depending only on x when 
y G ((x — b)/{2h), {x — a)/(2/i)). Thus the proof is complete. □ 

Proof of Theorem [T], Following the truncation steps in f3j we could truncate and 
re-normalize the random variables so that 

(6.1) \X,j \ < TnU^I'^, EX,j- = 0, = 1, 

where Tn'n}^'^ — >■ oo and — t- 0. Based on this one may then verify that 

(6.2) EXf, =3 + 0(-). 

n 

For any finite constants /i,--- by Cauchy's theorem and Fubini's theorem we 
write 

^g''(^"(-''-/Ix/«(^)*"(=''^') 
- ^ t ''ill ^»<'>^' - 11 1 J 



d 



^ /,( £ KC-^)(tTA-Hz) - nml{z))dzdt 



IhniVlyih 1 j^-^^ J-oc Tci 

d n ['"^j -f- 

Yh i / K{-^)dt{ivA-^{z)-nml{z))dz 



where the contour Ci is defined as before 



Furthermore, we conclude from (|3.9p and integration by parts that 

= -^==X^(Et-Et_i)/ r Kl*-^)dt[\nh{z)\' 

2Ai7rzVlnn"^ ^ JCiJ~oo " 

(6.4) . l^ E(IEfc-IE^-i)/ K{^)\n(^)dz, 

2/i7riVln/i-i ^ /ci ^Pfc(2:)^ 
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where in the last step one uses the fact that via (|2.6p 



(6.5) 



,t - 



,x — z. 



It is observed that the unique difference between (j6.4p and (j3.10p is that the test function 
K'{^^) there is replaced by K(^j^). Therefore, repeating the arguments in Section 2 
we obtain that (j6.4p is asymptotically normal with covariance (see (j3.64p and (j3.70p ) 

I ln(?2i° (zi) - m^{z2))dzidz2 + 0{—^). 



K 



^l- Zi ^.,X2 - Z2 



Ki 



h 



n. 



Also, for the nonrandom part we have 



(6.7) 



Note that 



1 



2/i7ri\/ln/i ^ Icx 



KC—-^)dt\n{mvA-^{z) - nml{z))dz. 
n 



/ K(^—^)dt\ < oo. 

~oo 



Likewise, repeating the arguments in Section 3 we see that (|6.7p becomes (see (j5.14p ) 
(6.8) 



1 



^ f - z 
K{—^)dt 

-oo 



Cn{rK{z)Y 



1 



c„«(z))^ 



) "^dz+Oi- 



(l + mO(z))3V (l + m0(,))2 



n 



The limits of (|6.6p and (|6.8p are derived in Appendix 3. 

Applying a change of variables and Fubini's theorem we obtain 

£ = £ [j K{y)f,St-hy)dy)dt 

(6.9) = j (^K{y) I' f,„{t-hy)dt)dy = J K{y)¥,„{x - hy)dy. 

By Taylor's expansion we have 

F,„(x - hy) = Fejx) + /ly/ejx) + 2-'hVfL{x - Ohy), 
where 9 G (0, 1). This, together with (|6.9p . yields that 

dt 

K{y){¥,^{x) + hyf,Sx) + 2-^h^y^f^^{x - dhy))dy 



h 



KC-f^)d¥,M 



y\<xo/{2h) 



+ 



y\>xo/{2h) 



K{y)¥,Sx-hy)dy, 
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where xq = min(a;, x — a,b — x) is positive since x G {a, b). Note that 

1/ K{y)¥,„ix-hy)dy\ < {Ah? /xl) [ y^\K{y)\dy, 

J\y\>xo/(2h) J 

I [ yK{y)dy\ = I / yK{y)dy\ < {2h/xo) [ y^\K{y)\dy 

J\y\<xo/{2h) J\y\>xo/{2h) J 

and fc^{x — Ohy) is bounded above by a finite constant depending only on x, and that 



VhTT^ 



dt 



" f(F.W-r.„(.,)+o(-jL=). 



Hence the proof of Theorem [T] is complete. □ 



7. The proof of Theorem [2] 



For any x, write 



{Xn,a - Xa) < x) = p(f„(x« + ^i^^) > a) = P(F„(x) > Qnix)) , 



■ V In n ' / V ^ n 

where 



and 



A / N n r_ / x\/lnn^ _ , x\^lnn^-, 
Vlnn n ' n 



9n{x) = — = a - Fc„ [xo, + ) . 

Vln n n " 



By Taylor's expansion we have 

gn{x) -xfc{Xa) 

and 

Fn{x) = -=[F„(Xa) -Fe„(x,)] +Op(l), 
Vlnn 

where we use Theorem [3] and the fact that Fn{x) and Fc(a;) are both continuous. The- 
orem [2] then follows the above and Theorem [TJ 

8. Appendix 1 

This Appendix collects some frequently used Lemmas. 

Lemma 7. (Lemma 2.2 of [2>\) Suppose that Xi, ■ ■ ■ ,Xn are i.i.d real random variables 
with KXi = and KXf = 1. Let x = {Xi, • • • ,Xn)'^ and D be any n x n complex 
matrix. Then for any p > 2 

E|x^Dx-trD|P < Mp[(E|Xi|^trDD*)P/2 + E|Xi|2Ptr(DD*)P/2]. 
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Lemma 8. Assume that v > M/^/n and u £ [a,b]. Then 

\m^{z)\ < M, |Em„(z)| < M, Mz)\ < M, np'^(z)f < M, E|/?fc(z)|8 < M; 

(8.1) ElFfcl^ < M/(nV2), E\rf^f < M/in^v^^), E\Ck{z)f < M/{n^v% 
for mi = 1,2 and m2 = 0, 1, 2, ms = 0, 1, 2, 

(8.2) E|center'=(s^A^"i(z)A-'^2(z)A-"^«(z)sfe)|^ < M/(n^t;«"i+8™2+8™«-4), 
where center'^ is defined in i3. 31]) and A^^(z) defined right before Section 3.1; 

(8.3) \un{z)\ = \z-{l- n-^)bi2{z)\-^ < M. 

Remark 4. Checking the argument of Lemma\^ indicates that all above estimates in- 
volving A'j^'^{z) (and A'j^^{z)) still hold if replacing A^^{z) (and A'f^^{z)) by A^j{z) 

(and A^j{z)) respectively. 

Proof. As pointed out in (6.1) in [11], we obtain 

(8.4) |m°(z)| < M, \ml{z)\ < M. 
It was proved in |10J that 

(8.5) |Em„(z)| < M, |Em„(z)| < M, \bi{z)\ < M. 

See Lemma 6.2 of [10] for the first estimate of (IB.ip and Cauchy's theorem ensures the 
second estimate of ()8.ip via the first estimate of (jS.ip . 

Write 

(8.6) /3f = bi- (3\'biTi = fei - blFi + l3\'blTl 
We then conclude from (13. 8p . (18. 6j) and Lemma 6.2 of [lOj that 

(8.7) E\p\'f < Mil + y-^ElTil^^) < M. 
Expand f3i{z) as 

(8.8) /3i = f^f - /3r/3ir/i = /Sf - + {(^I' ff^ii^l 
It follows from (j8.7p , (j3.6p and Lemma [7] that 

E|/3i(2)|8 < M + ME\{^\'fr]if + Mv-^E\T]i{z)^f{z)\^^ < M. 

From (j3^ and (|83|) we have 

(8.9) |n-^EtrA-^(z)| < M. 

As for ([82]) by Lemma [71 ([M|), ([H]) and ([83]) we then obtain 

E| center^ (s^ A^™^ (^) A^™^ (^) '"^^ (z)sfc) f 

< Mn-4E(n-HrA^ (^) '"^ (^) A^ (^) A^ '"^ (^)Afc '"^ (^) A^ '"^ (z))^ 
< Mn-^t--^'"! -^"^2-8^3+4 (•^|p^|4 ^ |9(n-iEtrA-i(z))|^) < Mn-\-^"'^-^"'^-^'^^+\ 

where A^^(z) denotes the complex conjugate of A^^(z) and we also use the fact that 

n-^EtrA-^(z)A-i(z) = t;~^9(n"^EtrA^ ^(z)). 
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This, together with ()8.ip . yields the estimate of ^1(2:). 
Via (f2^ we have 

(8.10) \z + (z)r^ = \z + zcnmliz) - 1 + Cn\~^ = \ml{z)\ < M 

which imphes that (z + (1 — n~^)zm^ (z)) is bounded. By (l830D . (|3371l and the 
equahty 

Un{z)-{z+{l-n~^)zrnn{z)) ^ = (l-n~-^)n„(z)(6i2(z)+zm° (z)) (z+(l-n~-'^)zm° (z)) ^ 
we obtain 

\uniz)\ < M{1 - n"^u"^/2)~^|z + (1 - n''^)zm^{z)\-'^ < M. 
This imphes (|8.3p . □ 

Lemma 9. Assume that v > Mj,I^Jn with M3 6emgi sufficiently large and u G [a,b]. 
Then 

(8.11) n-2E|trEfcA^i(^i)Afc H^2) - EtiA-\zi)A-^\z2)f < M/{n\''), 

(8.12) n-2E|trEfcA-i(z)A-2(^) _ EtrA,^\z)A-^iz)\^ < M/{v?v'^), 

(8.13) n-^¥\iiA-^^{z)Af{z) - EtrA^ 2(^)^^2(^)|2 ^ ^/(^2^9)_ 
and 

(8.14) |5(z)|"^E|ri|'^ < M/(n^7;^2). 

Remark 5. Checking on the argument of h8.ll]) shows that i8.11\) is still true when the 
notation E^. is removed. 

Proof. We begin with a martingale decomposition of the random variable of interest: 
n~hiA^\zi)EkA-\z2) - E{n-hrA~\zi)EkA^\z2)) 

n 

= ^(E, - E,_i) [trA^i(zi)EfcA^i(z2)] 

n 

= Y.^E, - E,_i) [trA, i(zi)E,A, 1(Z2) - trA,/(zi)EfeA^/(z2)] 

n 

= ^(Ej - Ej_i)(5i + 62 + S3), 

where, via ()3.23p . 

h = Pkj {zi>J^kj (^i)Efc ( (^2) A^/ (z2)sjsjA~/ (Z2)) A-/ (zi)sj- 
<52 = -/3kj{z^)sjA^}{z,)Ek{A^}iz2))A^}{z^)sj 

and 

,53 = -trA^/(zi)E,(/3fc,(z2)A^/(z2)s,sjA^/(z2)). 
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It follows from that 

(8.15) \6i\<v-^. 
This implies that when j > k, 

(E, - E,_i),^i = (E, - E,_i)6i2(zi)(5n - 612), 
where 612 = ^kji^i)^! and 

5ii =sjA^/(zi)Efe(/3fc,-(z2)Gfe(z2))A^/(zi)sj-n-HrA^/(^i)Efc(/?fc,(z2)Gfc(z2))A^^^ 

with Gk{z2) = A-/(z2)sjsjA-/(z2). We conclude from ([3:25|) . (ISTTSi) . (13:281) and 
Lemma [7] that 

E|n-i ^(Ej- - Ej-„i)((^ii + 6i2)\^ < ^E|(^ii|2 + E|(^i2p < M/{n^v^). 

For handling the case j < k, let 

aki = sjA^/(zi)A^/(z2)sj, Cfcji = Ofci - n-HrA^/(zi)A^/(z2). 
Applying ()3.26p and the equality for /3 (22) similar to ()3.26p yields 

(E, - E,_i)(5i = (E, - E,_i) [f^kM)ik^'2)al,] 

= bl2izi)bl2{z2)[Sl3 + 2(5l4 + 5l5 + ^16 + ^Ij], 

where 

5i3 = (E, -E,_i)(CfcV),5i4 = (E, -E,-_i)(aiin-HrA^/(zi)A,/(z2)), 
(^15 = -(E, - E,-_i) [f3k,{zi)^kM)al,] , <5i6 = -(E, - E,_i) [l,^{z2)i,^{z2Wk,] 

and 

5i-r = {E,-E,^,)[(3kM)^k^^2)Ckj{zi)i^^{z2)al,]. 

It follows from Lemma [8] that 

(8.16) E|Cfc,-i|^ < M/{n\^). 
In view of IKTB and (l330]l . 

n 

E|n-i ^(E, - E,_i)6i2(zi)6i2(22)('^i3)P < Af/(n3r;6). 
While (f3:iT|) and (l330D yield 

n 

E|n-i^(E, -E,_i)6i2(zi)6i2(^2)(<5i4)|' < M/(nV). 

It follows from ([3:251) that 

\^kj{zi)akiak2\ < Mt;-i||A^/(z2)sj-f = Mt;-^sjA^/(z2)A^/(z2)sj. 
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This, together with estimates similar to (I3.4ip and ()8.16p . ensures that 

n 

E|n-i J^(E, -E,_i)6i2(zi)6i2(^2)('^i5)|' < M/{n^v''). 

Obviously, this estimate applies to the term involving From (j3.25p and Lemma [8] 
we obtain 

n 

Summarizing the above we have 

n 

E|n-i J^(E, -E,_i)6i2(zi)6i2(^2)(<^i)P < M/(nV). 
Applying an argument similar to that for b\ in the case of j > k one may prove that 

n 

E|n-i^(E, -E,_i)6i2(zi)6i2(^2)((^2)P < M/(nV). 

When j > k 

n 

^(E,- - E,_i)6i2(zi)6i2(z2)(<53) = 0. 
When J < /c, as in dealing with 6i in the case j > k one may verify that 

n 

E\n~' Y^{Ej - E,_i)6i2(zi)6i2(z2)(<53)|' < M/(n\5). 

Thus, the proof of (|8.1ip is complete. 

As in (j4.33p . by Cauchy's theorem one may verify ()8.12p . Following the proof of 
(j8.1ip one can prove (j8.13p and the details are omitted here. 

Consider (j8.14p next. Thanks to (|3.24p . it is enough to consider trA^^(z)— EtrA^-'^(z) 
rather than Fi. As in (j3.9p write 

n 

trA-i(z) - EtrA-i(^) = - ^{^k - Efc_i)(/3fcS^A-2(z)sfc) 

k=l 

n n 

= - ^(Efc - Efc_i)(6ir?f ) + ^(Efe - Efc_i)(/3fc&iefcS^A-2sfe), 

k=l k=l 

where the last step uses p.Sp . It follows from (j4.23p . Lemmas [71 [8] and Burkholder's 
inequality that 

n 

n-8|5(z)|-iE|^(Efc-Efe_i)(r?f )|' < n-^\-%{z)\-^nMtTA-{\z)A:,\z)\'' < M/in^'v'^). 

k=l 
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Similarly, via (13. 7|) we obtain 



n 



\g{z)\-^E\ J^(Efc - Efc_i)(/3fc%s^A-2s,,)f < M/{n%^^) 

k=l 

and via (|3.4p . (j3.7p and Lemma [1] 

n 
k=l 

< Mn-^v-^\g{z)\-'^K\n-hTA-^{z) - n~^KtiA-^{z)f + M/{n^v'^'^). 
Summarizing the above we have 

(1 - Mn~^t;"^)E|n"HrA"^(z) - n"^EtrA"^(z)|^ < M/{n^v^'^), 
which implies (j8.14p . □ 



9. Appendix 2 

The aim in this section is to develop the asymptotic means and variances in Theorem 
Hland Theorem [TJ Consider ()3.70p first. Note that 



x[ln|m°(zi) -121° (-22) I + « arg(?21° (zi) - rrf^{z2))\dzidz2, 
where the contours Ci and C2 are two rectangles defined in (j3.3p and (j3.69p . respectively. 
As in Section 5 of [3j one may prove that 

(9.1) inf > 0, > i|^0(^^)^0(^^)|^ 

zGS,n Z\ — Z2 I 

where S is any bounded subset of C. 

To facilitate statements, denote the real parts of Zj by = 1,2. In what follows, 
let n — )• 00 first and then vq — )• 0. Then, as argued in the integrals in (j9.ip involving 
the arg term and the vertical sides approach zero. 



Define 



^(1) ^ ..,, Xx-Zx , X2-Z2 _ ,. Xi-Zi X2-Z2 , 
" ^rl ^ l^rK h ' h ' h ' 



Therefore it is enough to investigate the following integrals 

lai Jai-e 



'"'^'[K^hn |mO(zi) - m0(z2)| - i^i'^ In |mO(zi) - 
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(9.2) 
(9.3) 



1 



+ 



/l27r2 

1 

7^ 



Clr rar+s 



Clr rar+e 



0,1 Jai-e 



h 

X2- Z2. 
h ' 



mO(zi) -m0(z2) 



duidu2 



X In 



(m°(zi) -m°(22))(m°(2;i) -m0(z2)) 



duidu2, 



where K'^{h {x — z)) and K'-{h {x — z)), respectively, represent the real part and 
imaginary part of K'{h~^{x — z)), m^fz) stands for the complex conjugate of m^fz). 



We develop the limit of (|9.2p and (j9.3p below. To this end, we list some facts below. 
By (j2.6p and (j2.7p one may verify that 



(9.4) 



oo r+oo 



— oo J — oo 



K'{ui)K'iu2)Hui-U2) 



duidu2 < oo. 



In addition, it follows from (12. 6p that 



{Inh- 



x — a 
h 



x — b 
h 



Kiui) 



h 

x — b — e 



K'j.{u2)duidu2 — ^ 0. 



This, together with (j9.4p . implies that as n — )• oo 



1 



Xl—ar J X2—Cir—S 



K\^)K'C^) ln(ni - U2fduidu2 
n h 



~h h 



K'{ui)K'{u2) ln(ui-ii2) 



In 



duidu2 



(9.5) 



oo /■+00 



K' {ui)K' {u2)\'n.{ui — U2)^duidu2- 



oo J — oo 



By (|2.9p and the continuity property of K"{u + wq) and K'{u + wq) in u and vq it is 
not difficult to prove that 



(9.6) 

and 

(9.7) 



lim 



+ 00 



\K" (u + ivo)\du 



+ 00 



\K"{u)\du 



lim 



+ 00 



K^^\u + ivQ)du 



+ 00 



K^^\u)du, j = 0,1, 



where K^^") is the j-th derivative of K. 
By complex Roller's theorem 



(9.8) 



h 



h 
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because K'-{h ^{x — z)) = 0, where -^i lies in (0, fo))- Thus we conclude from ()9.ip and 
(fOjl that 

car 



du 



<vohhi{v^^h)- I \K" 



,x — u 



h 



+ ivi)\dui — >• 0, 



as n — )• oo, fo — )• 0, which implies that (j9.3p converges to zero. 
Consider ()9.2p next. As in ()2.ip from (j2.5p one may solve 

-(z + 1 - c) + v^(z + 1 - c)2 - 4z 



m{z) 



2z 



Note that the above equality still holds when c and rn{z) are, respectively replaced by 
Cri and ?2i^(^;). Also, when 2; — )• x € [a, 6] we have 



(9.9) 



rn{x) 



-(x + 1 — c) + i y/(x — a)(6 — x) 



It follows that for n G [(x — (x — a)//i], as n — )• 00, 
(9.10) \rrfn{zn) - rn{un)\ ^ 

where Zn = Un — iv^h with Un = x — uh. 
Now, as in [3j, for (|9.2p write 



In 



m^{zi) - mfl{z2) 



1 , 4m^^(2i)m°.(z2) 

2 I ^K(^i)-mO(^2)P^' 



where m^, -(z) denotes the imaginary part of m°(z). By ([M 

rqi2^ l^/^l I 4m°,(2i)mP,(z2) 

^ ^ v'^|mO(.i)-m°(z2)P 
In view of (|9.ip and Lemma [5] 



< In 1 + 



16m°.(zi)m°.(z2) 

(Ul - M2)^|221n(A)l2in(^2)|' 



(9.13) 



sup 

ui,U2£[a,b],vi,V2£[voh,l] 



(21)121° (22) p 



< 00. 



By the generalized dominated convergence theorem we then conclude from (j9.5p . ()9.7p . 
([TO]) . (f02]) . ([91^ that as n ^ 00 

mni'^ni - ivoh) - m^{un2 - ivoh/2) 



h 



x-^—ar I X2~-o,^ — £ 
h h 



Kl{zi)K',{z2) 



In 



In 



m(Uni) -m.{Un2, 



duidu2 



0, 



rn{uni) -rn{un2) 

where Unj = Xj — ujh, j = 1, 2. In addition, it follows from (19. 5p . (19. 7p . and inequalities 
similar to (|9.12p and (|9.13p that as n — )• 00 and then t>o — )• 



h h 



(k;(zi)/c;(z2) - K;.(ni)i^;,(^x2))in 



m(u„i) - m(u„2) 



duidu2 — 5- 0. 
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Therefore ()9.2p can be reduced to the following 



(9.14) 



C2-ai+e 



h h 



K'{ui)K'{u2)ln 



m{uni) -rn{un2) 



which turns to be 



1 



^l—ci fX2—ai+e 



m(u„i) -m{un2) 
m{xi — ui) — m(x2 — U2) 



duidu2 + 0(1), 



m{xi — ui) — m{x2 — U2) 



duidu2 + 0(1). 



f X\—ar J X2—(lr—S 

To handle (|9.14p . we need one more lemma: 
Lemma 10. Suppose that the function g{xi,X2) is continuous in xi and X2, 



(9.15) 
and 
(9.16) 



x-i—ai fX2—ai 



X\—ar J X2—CI' 



\g{xi — ui,X2 — U2)\duidu2 < 00 



xi-ai 



\g{xi — ui,X2)\dui < 00 

' xi —ar 

Then, as n 00 

rxi—ai /•X2—ai+£ 

(9.17) 



X2-ai 



\g{xi,X2 - U2)\du2 < 00. 



X2—ar 



1 



' Xi—ar J X2—a,r—£ 

where xi ^ a^Or and X2 7^ auCLr- 



K'{^)K'{^)g{xi -ui,X2- U2)duidu2 0, 



Proof. Define the sets Gi = (|ui| < 5i) n (|u2| > ^2), G2 = {\ui\ > 5i) n {\u2\ < 82) and 
G3 = (|ui| > Si) (1 {\u2\ > ^2)- Splitting the region of integration into the union of the 
sets (|ni| < 61) n (|ti2| < 62), Gi, G2 and G3 gives 



1 



Xi—ar J X2—(lr—S 



(9.18) 
where 



-?^'(-^)^'(y ) g{xi -ui,X2- U2) - g{xi,X2) 
<Ii + l2 + h + h + h, 



duidu2 



sup 

\ui\<Si,\u2\<S2 



h = \g{xi,X2)\ 



g{xi - ui,X2 - U2) - g{xi,X2) 

xi—o-i fX2—ai+£ 



+00 



\K'{u)\du 



1 

h? 

xi—ai [•X2—ai+e 



I{Gi U G2 U G3)K'{^)K'{^)duidu2 
n n 



Xl—ar ^ X2—0,r—£ 

-[^ i-xi-ai r-X2~ai+e 
h? I / 



I{Gi)K'{^)K'{^)g{xi - ui,X2 - U2)duidu2 
n n 

I{G2)K'{^)K'{^)g{xi - ui,X2 - U2)duidu2 



and 



XI ai ,X2 ''1+^ U1U2 ,,Ui U2 g(^Xi-Ui^lC2-U2) 

/ ^('^3)-72--^ ( — )^ ( — ) — ^^1^112 



h 



h 



UIU2 
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Evidently, Ii — )• due to the continuity property of g{xi,X2) when 6i and 62 converge 
to zero. As n — )• 00, for I2 we have 

/r+00 
\K'{u)\du / \K'{u)\du^O, 
J —00 

\u\>5/h 

and for by (j9.16p we obtain 

h < i^lhy^ sup \uiK'{ui)\ sup \U2K'{U2)\ 

\'>J-i\>Si/h \'U-2\>S2/h 

xi—ai rX2—ai+e 

I \g{xi - ui,X2 - U2)\duidu2 ^ 

Consider /a. Similar to Is, 

/i'X2-ai+e 
/ \K'{ui)g{xi - uih,X2 - U2)\duidu2- 

While, as n —7- 00 and then 5i — t- 0, by the dominated convergence theorem 

f Ui r^2-ai+e 

\K'{—)\ \{g{xi - ui,X2 - U2) - g{xi,X2 - U2))\duidu2 ^ 0. 

J \ui\<5i J X2—ar—e 

From (|9.16p we then see that Is — )• 0. One may similarly prove that I4 converges to 
zero as well. We summarize the above that (j9.18p converges to zero as n — )• 00 first and 
then both 5i — )• and S2 — ?• 0. In addition, apparently, 

x-i —ar 

(9.19) g(xi,X2)h-^ / K'(^)du = gixi,X2) / " K'{u)du 



g{xi,X2)K{u) 



xi—ai 



Thus (j9.17p is proved. □ 

We are now in a position to apply Lemma [10] to ()9.14p . It follows from (j9.9p that 
m{xi) 7^ rn{x2) and m{xi) 7^ 'm{x2) whenever xi 7^ X2- Also, note (5.1) in [3j. There- 
fore g{xi,X2) = In (|m(a;i) — m^{x2)\\rn{xi) — m{x2)\~^) is continuous in xi and X2. 
Furthermore, it is straightforward to show that In (l + Af ((xi — X2) — {ui — U2)) ^) 

for ui,U2 G [ai — e, + e] is Lebesgue integrable and In (l + M(^{xi — X2) — ^i) ^) 
for U2 G [a/ — e, + e] is Lebesgue integrable. Thus, in view of inequalities similar to 
(|9TT]l - (l9l3] l and applying (l9l71) we have 



1 l-xi-ai i-X2-at+e 



rn[xi — ui) — m[X2 — U2 ) 



duidu2 — > 0, 



m(xi — ui) — m,(X2 — U2 ) 
which is the limit of (19. 2p due to (I9.14p when xi ^ X2. 

When xi = X2 = X taking g{xi,X2) = In \m{x) — m(x)| and applying ()9.17p we obtain 

(9.21) — / / K'{^)K'{^)ln\m{x -ui) -m{x -U2)\duidu2 ^0. 

1^ Jx—ar Jx—ar—e 
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Here we keep in mind that the boundary points are not considered when investigating 
the case xi = X2 = x. Consider next 



(9.22) 



1 



/l2 



, Ul. 



x~b 



h 



x—a+e 



K ( — ) In \rn{x — ui) — m{x — U2)\duidu2. 

x—b—e 



By complex Roller's theorem we have 

In m(x — Ul) — m{x — U2) 



2-1 In ((m - U2f[\m!^{x - ng)^ + jm^x - ^4)^]) 



(9.23) 



1-1 



hi{ui-U2) +2 gri{x - ui,x - U2), 



where gr{x - ui,x - U2) = In (|mj.(ti(x - ui) + (1 - ti)(x - ^2))^ + \mli{t2{x - ui) + 
(1 - t2){x - ■U2))P), = tiui + (1 - ti)u2, M4 = t2Ui + (1 - t2)u2 and ti,t2 e (0, 1). It 
follows from inequalities for rn{x) similar to (|9.ip that 



x—a fx—a+e 



In \rn{x — ui) — m{x — U2)\duidu2\ < oo. 

I x—b J x—b—£ 

This, together with (j9.23p . ensures that 

/•x — a rx—a+e 
I / / gr{x — Ul,X — U2)duidU2\ < OO. 

J x~b J x—b—e 

Similarly, one may check the remaining conditions in Lemma [TUl Therefore, using 
Lemma [10] with g{xi,X2) = ln|m'(x)p gives 



(9.24) 



1 



x—b 



x—a+e 



x—b—e 



K'(-^)gr(x — Ui,X — U2)duidU2 
h 



0. 



We then conclude from ([223]), and dSS]) that 



1 1 fX—a 



x—b—e 



K'C^) ln(ui - U2fduidu2 + o(l) 



(9.25) 



K' {ui)K' {u2) ln(ni — U2)^duidu2 



which is minus the limit of (j9.2p due to (]9.2ip and (I9.14p when xi = X2- 
Limit of (|5.15p . From an expression similar to (j2.5p we obtain 



|MS(--) = (MSWf(l-c^jM|£p 



It follows that (|5.15p becomes 



(9.26) 



^/K(^)Aln 
47ri ,/ h dz 



Anhi 



•(l + m0(z))2 
'(l + m0(z))2 



dz 



dz. 
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In view of (I4.12p and ()4.4p we see that the integrals on the two vertical lines in ()9.26p 
are bounded by Mvlnv"^ , which converges to zero as — )• 0. The integrals on the two 
horizontal lines are equal to 



(9.27) 
(9.28) 



1 



+ 



27r/i 
1 

2TTh 



1 



{rnl{z)f 



•(l + m0(z))2 
(l+m0(z))2 



du 



du. 



By (|4.12p . and ([918]) . (|9.27p is bounded by MvlnV^, converging to zero. It follows 
from ([91^ that 

(mP(z„))^ im{un)f 
(l + m0(z„))2 {l + m{unW 
We then conclude from the dominated convergence theorem that 



K'Jz) 



are I 1 — c- 



(llln(^n))' 



•(l + m0(z„))2 
Moreover, by (19. 7p we obtain 

{K'j.{z) — K'^{u)) arg 



arg ( 1 — c 



(m(u^))2 
(l+m(n„))2 



dn — ^ 0. 



1 -c- 



(m(u„))^ 



— )• 0. 



'(l+m(n„))2. 

By (j9.19p and Theorem lA in [20j (replacing K{x) there by K'{x)) we see that 



K'^ (n) arg 



(m(u„))^ 



dn — ^ 0. 



(l + m(n„))2 

Summarizing the above yields that (I5.15P converges to zero. 

Limits of (16. 6p and (16. Sh . Repeating the argument leading to (|9.14p yields that (|6.6 
becomes 
(9.29) 



1 



/i2 ln/i-1 



h 



h 



myxi — ui) — m[X2 — U2) 



m{xi — ui) — m{x2 — U2) 



duidu2 + 0(1). 



The argument of (I9.18|) in Lemma fTOl indeed also, together with (12. 7p . gives 



(9.30) 



1 



Xi—ai rX2 — (ii-r€ 



K{^)K{^)g{xi -ui,X2- U2)duidu2 - g{xi,X2) 0. 



f X\—ar J X2—Cir—£ 

This ensures that (j9.29p converges to zero when xi ^ X2- When xi = X2 = x, by ()9.30p 
we have 



1 



/i2 ln/i-1 



K{^)K{^) In m{xi - ui) - m{x2 - U2) 
h h 



duidu2 — ?• 0. 



Applying (fOOD and replacing K'{x) in (fOHD . (fmp and (l9:25]l by K{x), we can 

prove that 



/i2 In/i^i 



xi—ai cX2~ai+e 



XI— ar 'J X2—CL1 — e 



K{^)K{^) In m{xi - ui) - m{x2 - U2] 



duidu2 



1. 
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Moreover, from the conditions on h one may show that 

Inn 



In/i-i 



Checking on the argument of (jS.lSp and replacing K'{x) there with K[x), along 
with (l6.5p . we have (]6.8p — )• 0. Thus the proof is complete. 
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